o 0 ib @s,UddlZddlmZddlmZmZddlmZddlm Z zddl m Z m Z m Z mZmZmZmZd Zd e d d d id e ddd ie ddd e je ddd idd e ddd ie je ddd e je ddd ie je ddd idd e je jBe ddddiid e je jBe ddddiid e je jBe ddddiid e je jBe ddddiid e je jBe dd ddiid e je jBe dd!ddiid" Zeeeee efe ffed#<eeWneyd$Zd%d&ZGd'd(d(Z d)d*Zd+d,ZYnwd-eed.efd/d0Zd-ed.dfd1d2Zgd3ZdS)4N)partial)OptionalUnion)lazy_import_flash_attention)flash_attention_forward)DeviceLayerRepositoryMode get_kernelregister_kernel_mappingreplace_kernel_forward_from_hubuse_kernel_forward_from_hubTcudaz!kernels-community/deformable-detrMultiScaleDeformableAttention)repo_id layer_namezkernels-community/moe Llama4TextMoezkernels-community/liger_kernelsZ LigerRMSNorm)rZrocmzmedmekk/triton-llama-mlpZTritonLlamaMLPzkernels-community/megablocksMegaBlocksMoeMLPzahadnagy/megablockszkernels-community/activationFastGELUz>=0.0.4,<0.1.0)rrversion QuickGELUNewGELUZSiluz>=0.1.0ZGeluGeluTanh) rrZRMSNormZMLPrrrrZSiLUZGeLUr_KERNEL_MAPPINGFcOs dd}|S)NcSs|S)N)clsrrq/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/transformers/integrations/hub_kernels.py decoratorsz.use_kernel_forward_from_hub..decoratorr)argskwargsrrrrrsrc@seZdZddZdS)r cOtd)NzNLayerRepository requires `kernels` to be installed. Run `pip install kernels`. RuntimeError)selfr r!rrr__init__zLayerRepository.__init__N)__name__ __module__ __qualname__r&rrrrr s r cOr")Nz^replace_kernel_forward_from_hub requires `kernels` to be installed. Run `pip install kernels`.r#r r!rrrrsrcOr")NzVregister_kernel_mapping requires `kernels` to be installed. Run `pip install kernels`.r#r+rrrr r'r attn_implementationreturncCs|duo td|duS)zJCheck whether `attn_implementation` matches a kernel pattern from the hub.Nz'^[^/:]+/[^/:]+(?:@[^/:]+)?(?::[^/:]+)?$)research)r,rrr is_kernelsr0c CsRt|sdSts tdddlm}ddlm}d}|}d|vr,|d\}}||}d|vr<|d\}}| }n|}d}| }| d\}}}| }|rV| nd}zt ||d } Wnt yw} z t d |d | d d} ~ wwt| d r|durt}t|| d} t| ddn |durt| |} ||| |||ddS)zALoad and register the kernel associated to `attn_implementation`.Nz`kernels` is either not installed or uses an incompatible version. Please install the latest version with `pip install -U kernels`.r)ALL_MASK_ATTENTION_FUNCTIONS)ALL_ATTENTION_FUNCTIONS|:@)revisionz-An error occurred while trying to load from 'z': .Zflash_attn_varlen_func)implementationT)Z force_importZflash_attention_2)r0_kernels_available ImportErrorZ masking_utilsr1Zmodeling_utilsr2splitgetstrip partitionr Exception ValueErrorhasattrrrrgetattrregister) r,r1r2Zattention_wrapperZactual_attn_namerZ kernel_name_revZkerneleZkernel_functionrrrload_and_register_kernelsJ        rG)r rr r)r. functoolsrtypingrrZmodeling_flash_attention_utilsrZflash_attentionrZkernelsr r r r r rrr9Z INFERENCEZTRAININGZ TORCH_COMPILErdictstr__annotations__r:boolr0rG__all__rrrrs   $        & f   4