o Zh`@s UddlmZmZddlmZzNddlmZmZmZm Z ddlm Z dZ dedd d ided d d ided dddideddd idZ eeeeeefeffed<ee ddZ Wney{ddZ GdddZddZ ddZdZ Ynwdd Zgd!Zd"S)#)DictUnion)is_torchdynamo_compiling)DeviceLayerRepositoryregister_kernel_mappingreplace_kernel_forward_from_hub)use_kernel_forward_from_hubTcudaz!kernels-community/deformable-detrMultiScaleDeformableAttention)repo_id layer_namezkernels-community/moe Llama4TextMoez#kernels-community/triton-layer-normZ LlamaRMSNormzpure-layer-test)r rrevisionzmedmekk/triton-llama-mlpZTritonLlamaMLP)r rZRMSNormZMLP_KERNEL_MAPPINGcsfdd}|S)a5 Expands `kernels`' `use_kernel_forward_from_hub` to NOT use a kernel at compile time. This should be removed when `kernels` supports `torch.compile`. If the layer has a `config` attribute, we can also set `config.disable_custom_kernels = True` to disable the kernel. cs<jti}|jfdd}|_S)Ncs>tdo tjdd}ts|r|i|S|i|S)Nconfigdisable_custom_kernels)hasattrgetattrrr)Z forward_argsZforward_kwargsrclsZkernel_forwardZoriginal_forwardT/var/www/auris/lib/python3.10/site-packages/transformers/integrations/hub_kernels.pyforward_with_compile_pathSs zcuse_kernel_forward_from_hub..decorator_with_compile_path..forward_with_compile_path)forward$original_use_kernel_forward_from_hub)r decoratorrargskwargsrrdecorator_with_compile_pathHsz@use_kernel_forward_from_hub..decorator_with_compile_pathr)rr r!rrrr ?s r cOs dd}|S)NcSs|SNr)rrrrrez.use_kernel_forward_from_hub..decoratorr)rr rrrrr dsc@seZdZddZdS)rcOtd)NzNLayerRepository requires `kernels` to be installed. Run `pip install kernels`. RuntimeError)selfrr rrr__init__kzLayerRepository.__init__N)__name__ __module__ __qualname__r(rrrrrjs rcOr$)Nz^replace_kernel_forward_from_hub requires `kernels` to be installed. Run `pip install kernels`.r%rrrrr nsr cOr$)NzVregister_kernel_mapping requires `kernels` to be installed. Run `pip install kernels`.r%rrrrrsr)rFcCstSr")_hub_kernels_availablerrrris_hub_kernels_availableyr#r.)rr.r rr N)typingrrutilsrZkernelsrrrr r rr-rstr__annotations__ ImportErrorr.__all__rrrrsN  &  "