o p i!@sxddlmZddlZddlmZmZddlmZddlmZddl m Z ddl m Z d d l mZgZGd d d eZdS) ) annotationsN)_C_opspir) unique_name) framework)check_variable_and_dtype)no_grad) Initializercs0eZdZdZddfd d ZddddZZS) OrthogonaluThe orthogonal initializer. The initialized tensor is (semi) orthogonal. It's only applied to Tensor whose dimension is greater than or equal to 2. For the Tensor whose dimension is greater than 2, the 0 dimension is seen as ``rows`` , and the >=1 dimension are flattened as ``cols`` . Which can be describe as: .. code-block:: text rows = shape[0] cols = shape[1]·shape[2]···shape[N] if rows < cols: The rows are orthogonal vectors elif rows > cols: The columns are orthogonal vectors else rows = cols: Both rows and columns are orthogonal vectors Args: gain(float, optional): The multiplication coefficient for initialized tensor. Default: 1.0. name(str|None, optional): The default value is None. Normally there is no need for user to set this property. For more information, please refer to :ref:`api_guide_Name`. Returns: A parameter initialized by orthogonal initialized. Examples: .. code-block:: python >>> import paddle >>> weight_attr = paddle.ParamAttr(initializer=paddle.nn.initializer.Orthogonal()) >>> linear = paddle.nn.Linear(10, 15, weight_attr=weight_attr) >>> # linear.weight: X * X' = I >>> linear = paddle.nn.Linear(15, 10, weight_attr=weight_attr) >>> # linear.weight: X' * X = I ?Ngainfloatname str | NonereturnNonecs$|dusJdt||_dS)Nzgain should not be None)super__init___gain)selfrr __class__g/home/app/PaddleOCR-VL/.venv_paddleocr/lib/python3.10/site-packages/paddle/nn/initializer/orthogonal.pyrFs  zOrthogonal.__init__var paddle.Tensorblockpir.Block | Nonec Cs0t|tjr|rJd||}t|tjtjjtj j fs"Jt|tj tj fs-J|j j |_|j}t|dks?Jd|d}d}|ddD]}||9}qKt||t||g}trtUt}t|dd|j|j|} t| d \} } t| dd} t| } t| | } ||krt| ddg} t| |j} t| |j dd }|!| WddS1swYnMt"rt}t|dd|j|j|} t| d \} } t| dd} t| } t| | } ||krt| ddg} t| |j} t| |j dd }|St#|d d d gd|j$t%&d'ddg|jdd d} |j(did | idd||j|jdd d|j$t%&d'gd| jdd d} |j$t%&d'gd| jdd d} |j(dd| gi| | ddd id d|j$t%&d'ddg| jdd d} |j(dd| id | idddd d| } |j(dd| gid | id d |j(d!| | d"d | iid d|j$t%&d'gd#| jdd d}||kr|j$t%&d'd$dg| jdd d}|j(d%d| i||d&d'ddgid d|} |j(d(d| i| |d&d)|jid d|j(d*d| id |i|j dd+d,}|S)-aInitialize the input tensor with orthogonal initializer. Args: var(Tensor): Tensor that needs to be initialized. block(Block|None, optional): The block in which initialization ops should be added. Used in static graph only, default None. Returns: The last initialization op, it contain 8 ops in orthogonal initializer. zGCurrently, orthogonal initializer not support lazy init for dist param.zFOnly Tensor with 2 or more dimensions can be initialized by Orthogonalrr Ngr ZreducedTOutZfloat32Zfloat64r .Zgaussian_randomtmpF)rdtypeZ persistable stop_gradient)meanZstdshapeseedr$)typeinputsoutputsattrsr%)qrqr#)r-rr#r-X)QRmodediagZdiag_v2)offsetZ padding_valuesign)r)r*r+r%Zelementwise_mul)r0Y) transposer'r#r8Z transpose2)r!ZXShapeZaxisZreshape2r'scale)r9Zbias)r)r*r+r,)) isinstancerZEagerParamBaseZis_distZ _check_blockVariablepaddlerValuecoreZ ParameterMetaZBlockprogramZ random_seedZ_seedr'lenmaxminZin_dygraph_moder Z_current_expected_placerZgaussianr$r-r4r6multiplyr8Zreshaper9rZ_share_underline_tensor_toZ in_pir_moderZ create_varrgeneratejoinZ append_op)rrrr'rowcoliZ flatten_shapeZplaceZ normal_varr.r/Zr_diagZr_signr#Zx_shapeZ q_transposeoprrr__call__Ks8       "        zOrthogonal.__call__)r N)rrrrrr)N)rrrr)__name__ __module__ __qualname____doc__rrJ __classcell__rrrrr s)r ) __future__rr<rrZ paddle.utilsrbaserZbase.data_feederrZ base.dygraphr Z initializerr __all__r rrrrs