o p i ,@sddlmZddlmZddlmZmZddlmZddl m Z m Z m Z ddl mZddlmZdd lmZmZmZerJdd lmZdd lmZmZgZed d ddd d4d5ddZ   d6d7d%d&Zd8d)d*Z +  ,d9d:d2d3ZdS);) annotations) TYPE_CHECKING)_C_opstensor) deprecated) check_dtype check_typecheck_variable_and_dtype) LayerHelper)Variable)convert_np_dtype_to_dtype_corein_dynamic_or_pir_mode)Tensor) DataLayout2D DTypeLikez2.5.2zpaddle.diag_embedz>> import paddle >>> lengths = paddle.to_tensor([10, 9, 8]) >>> mask = paddle.nn.functional.sequence_mask(lengths) >>> print(mask) Tensor(shape=[3, 10], dtype=int64, place=Place(cpu), stop_gradient=True, [[1, 1, 1, 1, 1, 1, 1, 1, 1, 1], [1, 1, 1, 1, 1, 1, 1, 1, 1, 0], [1, 1, 1, 1, 1, 1, 1, 1, 0, 0]]) NrT sequence_maskr%XZ out_dtypeZ MaxLenTensorr#Ytypeinputsoutputsattrs)r()r isinstancerZVarDescZVarTypeZDataTyper rr(Z stop_gradientr locals"create_variable_for_type_inferencer%r append_op)r"r#r%r&outhelperr.r0rrr r(8s*A      r(idsparentscCs|jdkr td|j|jkrtdtr&t|jdddgdt||Stdit}t |dddgdt |dddgd|j |jd }|j d||d d |id |S)a To be used after beam search. After beam search, we get selected ids at each time step and the corresponding parents in the search tree. Both ids and parents have the layout :attr:`[max_time, batch_size, beam_size]`. Then :attr:`gather_tree` is used to backtrace from the last time step and generate the full sequences by collecting selected ids. Here is an example: .. code-block:: text Given: ids = [[[2 2] [6 1]] [[3 9] [6 1]] [[0 1] [9 0]]] parents = [[[0 0] [1 1]] [[1 0] [1 0]] [[0 0] [0 1]]] Then: gather_tree(ids, parents) = [[[2 2] [1 6]] [[3 3] [6 1]] [[0 1] [9 0]]] Args: ids(Tensor): A Tensor with shape :attr:`[length, batch_size, beam_size]` and data type :attr:`int32` or :attr:`int64`. It contains the selected ids of all time steps. parents(Tensor): A Tensor with the same shape and data type as :attr:`ids`, It contains the parents corresponding to selected ids when searching among beams. Returns: A Tensor with the same shape and data type as :attr:`ids`. \ It contains the full sequences. The sequences are collected from \ :attr:`ids` by backtracing according to :attr:`parents`. Examples: .. code-block:: python >>> import paddle >>> ids = paddle.to_tensor([[[2, 2], [6, 1]], [[3, 9], [6, 1]], [[0, 1], [9, 0]]]) >>> parents = paddle.to_tensor([[[0, 0], [1, 1]], [[1, 0], [1, 0]], [[0, 0], [0, 1]]]) >>> final_sequences = paddle.nn.functional.gather_tree(ids, parents) >>> [[[2, 2], [1, 6]], [[3, 3], [6, 1]], [[0, 1], [9, 0]]] >>> final_sequences = paddle.nn.functional.gather_tree(ids, parents) >>> print(final_sequences) Tensor(shape=[3, 2, 2], dtype=int64, place=Place(cpu), stop_gradient=True, [[[2, 2], [1, 6]], [[3, 3], [6, 1]], [[0, 1], [9, 0]]]) rzLThe input ids must be a 3D tensor with shape [length, batch_size, beam_size]z4The ids's shape must be the same as parents' shape. r8Zint32r! gather_treer7r))ZIdsZParentsOut)r-r.r/N)r9) ndim ValueErrorrrr%rr9r r2r r3r4)r7r8r6r5rrr r9s* G   r9?NCHWseg_num shift_ratiofloat data_formatDataLayout2D | strcCs|dvr td|dtrt||||Stdit}t|dgddt|dtdt|dt d|j |j d }t |tsFt d |jdd |id |i|||d d|S)a **Temporal Shift Operator** Calculate the temporal shifting features for Input(X). Input(X) should be in shape of [N*T, C, H, W] or [N*T, H, W, C], while N is the batch size, T is the temporal segment number specified by :attr:`seg_num`, C is the channel number, H and W is the height and width of features. Temporal Shifting is calculated as follows when data format is NCHW: Step 1: Reshape Input(X) to [N, T, C, H, W]. Step 2: Pad 0 to reshaping result in the 2nd(T) dimension with padding width as 1 on each side, padding result will be in shape of [N, T+2, C, H, W]. Step 3: Assume :attr:`shift_ratio` is :math:`1/4`, slice padding result as follows: $$ slice1 = x[:, :T, :C/4, :, :] $$ $$ slice2 = x[:, 2:T+2, C/4:C/2, :, :] $$ $$ slice3 = x[:, 1:T+1, C/2:, :, :] $$ Step 4: Concatenate three slices along the 3rd(C) dimension and reshape result to [N*T, C, H, W]. For details of temporal shifting, please refer to paper: `Temporal Shift Module `_ . Args: x(Tensor): ${x_comment} seg_num(int): ${seg_num_comment} shift_ratio(float): ${shift_ratio_comment} name(str|None, optional): For detailed information, please refer to :ref:`api_guide_Name`. Usually name is no need to set and None by default. data_format(str, optional): Data format that specifies the layout of input. It can be "NCHW" or "NHWC". Default: "NCHW". Returns: out(Tensor): The temporal shifting result is a tensor with the same shape and same data type as the input. Examples: .. code-block:: python >>> import paddle >>> import paddle.nn.functional as F >>> input = paddle.randn([6, 4, 2, 2]) >>> out = F.temporal_shift(x=input, seg_num=2, shift_ratio=0.2) )r>ZNHWCzJAttr(data_format) should be 'NCHW' or 'NHWC'. Received Attr(data_format): .temporal_shiftr")Zfloat16Zuint16Zfloat32Zfloat64r?r@r)zseg_num must be int type.r*r:)r?r@rBr,N)rE)r<rrrEr r2r r rrAr3r%r1 TypeErrorr4)r"r?r@r&rBr6r5rrr rEs<D  rE)rrr) rrrrrrrrrr)Nr!N) r"rr#r$r%rr&r'rr)r7rr8rrr)r=Nr>) r"rr?rr@rAr&r'rBrCrr) __future__rtypingrZpaddlerrZ paddle.utilsrZbase.data_feederrr r Zbase.layer_helperr Zcommon_ops_importr Z frameworkr rrrZpaddle._typingrr__all__rr(r9rErrrr s:       ]e