o á)iã @sÜddlmZmZmZddlZddlZddlmZdejdejfdd„Z ddejd e dejfd d „Z ddejd e dejfd d„Z ddejde d e deejfdd„Z  ddeeeeejeffde fdd„ZdS)é)ÚAnyÚOptionalÚUnionNé)Ú get_tp_groupÚinput_ÚreturncCs tƒ |¡S)z8All-reduce the input tensor across model parallel group.)rZ all_reduce)r©r úm/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/vllm/distributed/communication_op.pyÚ tensor_model_parallel_all_reduce s r éÿÿÿÿÚdimcCótƒ ||¡S)z8All-gather the input tensor across model parallel group.)rZ all_gather©rr r r r Ú tensor_model_parallel_all_gatherórcCr)zsB  ÿÿ ÿ ÿÿ ÿ þÿþ þþ ÿþ