o * is@sddlmZddlmZmZddlZddlmZddlm Z m Z ddl m Z er:ddlm Z ddlmZdd lmZ  dd ddZd!d"ddZ   d#d$ddZdS)%) annotations) TYPE_CHECKINGAnyN)stream)_get_global_group_warn_cur_rank_not_in_groupconvert_object_to_tensor)Tensor)task)GroupTtensorr dstintgroup Group | Nonesync_opboolreturn task | NonecCstj||||ddS)a Send a tensor to the receiver. Args: tensor (Tensor): The Tensor to send. Its data type should be float16, float32, float64, int32, int64, int8, uint8, bool or bfloat16. dst (int): The destination rank id. group (Group, optional): The group instance return by new_group or None for global default group. Default: None. sync_op (bool, optional): Whether this op is a sync op. The default value is True. Returns: Return a task object. Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> if dist.get_rank() == 0: ... data = paddle.to_tensor([7, 8, 9]) ... dist.send(data, dst=1) >>> else: ... data = paddle.to_tensor([1, 2, 3]) ... dist.recv(data, src=0) >>> print(data) >>> # [7, 8, 9] (2 GPUs) F)rrrZuse_calc_stream)rsend)r rrrrq/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/paddle/distributed/communication/send.pyr#s$ rcCst|||ddS)aB Send tensor asynchronously Args: tensor (Tensor): The Tensor to send. Its data type should be float16, float32, float64, int32, int64, int8, uint8, bool or bfloat16. dst (int): The destination rank. group (Group, optional): The group instance return by new_group or None for global default group. Default: None. Returns: Return a task object. Warning: This API only supports the dygraph mode. Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> if dist.get_rank() == 0: ... data = paddle.to_tensor([7, 8, 9]) ... task = dist.isend(data, dst=1) >>> else: ... data = paddle.to_tensor([1, 2, 3]) ... task = dist.irecv(data, src=0) >>> task.wait() # type: ignore[union-attr] >>> print(data) >>> # [7, 8, 9] (2 GPUs) F)r)r)r rrrrrisendLs#r object_list list[Any] int | None dst_in_groupc Cs|dus t|dkrtd|durtn|}t|rdS|dur/|dur)td||}n|dur5dn|}tdd|D\}}dd|D}tj|dd }t|||d t|d krb|d}nt |}t|||d dS) a[ Send a list of Python objects to the receiver. Args: object_list (list): The list of Python objects to send. dst (int, optional): The destination rank id. Default: 0. group (Group, optional): The group instance return by new_group or None for global default group. Default: None. dst_in_group (int, optional): The destination rank within the group. Cannot be specified together with dst. Default: None. Returns: This function does not return any value. Examples: .. code-block:: python >>> # doctest: +REQUIRES(env: DISTRIBUTED) >>> import paddle >>> import paddle.distributed as dist >>> dist.init_parallel_env() >>> if dist.get_rank() == 0: ... data = ["hello", {"key": 100}, [1, 2, 3]] ... dist.send_object_list(data, dst=1) >>> else: ... data = [None] * 3 # type: ignore ... dist.recv_object_list(data, src=0) >>> print(data) >>> # ["hello", {"key": 100}, [1, 2, 3]] (2 GPUs) Nrz#object_list cannot be None or emptyz7Cannot specify both 'dst' and 'dst_in_group' arguments.cSsg|]}t|qSrr).0objrrr z$send_object_list..cSsg|]}|qSr)item)rsizerrrr r!Zint64)Zdtype)rr) len ValueErrorrrZget_global_rankzippaddleZ to_tensorrconcat) rrrrZ tensor_listZ size_listZsize_list_valuesZobject_sizes_tensorZ object_tensorrrrsend_object_listrs,#     r*)rNT) r r rrrrrrrr)N)r r rrrrrr)NNN)rrrrrrrr) __future__rtypingrrr(Z paddle.distributed.communicationrZ&paddle.distributed.communication.grouprrZ4paddle.distributed.communication.serialization_utilsr r Zpaddle.base.corer r rrr*rrrrs&       )(