[Th3h|%SSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKJrJ r J r J r J r J r SSKrSSKJr SSKJr SSKJr SSKJrJr SSKrSSKJr /SQrSS S .r1S krS rS,S \S\R<\S\R>4Sjjr 0r!\"\S4\#S'"SS5r$\RJ"SS55r&S\S\ 4Sjr'S\SS4Sjr(S\SS4Sjr)S \S\*\\44Sjr+S\SS4Sjr,S \RZS\.4S!jr/S\S"\R>SS4S#jr0S$\RbS%\SS4S&jr2S'r3S(r4S-S)jr5S*r6S.S+jr7g)/N)FunctionSchema OperatorName SchemaKindBaseTypeListTypeBaseTy)get_ctx)autograd_kernel_indirectionconstruct_autograd_kernel) infer_schema) custom_opCustomOpr CPUCUDA)cpucuda>atatenprimprimstorchpytorchc:[R"S[5 g)Nzwtorch._custom_op is deprecated and will be removed in PyTorch 2.6, please use the equivalent torch.library API instead.)warningswarnDeprecationWarningM/var/www/auris/envauris/lib/python3.13/site-packages/torch/_custom_op/impl.pywarn_deprecatedr!-s MM 89KMrqualname manual_schemareturnc,^^[5 UU4SjnU$)D This API is deprecated, please use torch.library.custom_op instead c >[R"U5(d[S[U535e[ T 5up[ U5 UR U:wa[ST SUSUR S35eT c [USS9OT nUU3n[R"U5n[U5 T b [XP5 [R"US5nURU5 [XR 5n[#XaXRUS S 9nUR UlUR$UlUR&Ul[R("XhR*S 5"[-[.R0"U555 [2R4R7U[8R:"[<[.R0"U555 U$) NzDcustom_op(...)(func): Expected `func` to be a Python function, got: zcustom_op(qualname='z-', ...)(func): expected `func` to have name 'z ' but got 'zX'. Please either change the name of `func` or the qualname that is passed to `custom_op`r) mutates_argsFRAGMENTT_private_accessAutograd)inspect isfunction ValueErrortypeparse_qualnamevalidate_namespace__name__r rparsevalidate_schema validate_function_matches_schemalibraryLibrarydefinefind_ophandle_or_thrownamer __module____doc__impl_opnamer weakrefproxyr_C#_dispatch_set_report_error_callback functoolspartialreport_error_callback) funcnsr;schema schema_strfunction_schemalibophandleresultr#r"s r innercustom_op..inner;s!!$''""&t*/  "(+2 ==D &xj1!!%k$--A+, 9F8Md4S`vfX& (..z:(  $ ,_ Coob*- :)".B.BC#?(TXY-- OO S..*5 ' f(= >  44 i''(=w}}V?TU  r)r!)r"r#rOs`` r rr3s )V Lrrglobal_registryc@^\rSrSrSrSS.U4SjjrSrSSjrSrS r S r S r S r SS \ R\\ R \4S\ R"4SjjrSrS\ R"4SjrSS\ R"4SjjrSrSrSrSrSSjrSSjrSrU=r$)rrr&Fr*c>[TU]5 [5 U(d [S5eUSU3nX0lX lXlXPlX@lXpl SUl 0Ul SUl U[UR'g)Nz|The CustomOp constructor is private and we do not guarantee BC for it. Please use custom_op(...) to create a CustomOp object::F)super__init__r! RuntimeError_schema_cpp_ns_lib _ophandler? _qualnamer3_impls'_registered_autograd_kernel_indirectionrQ) selfrLcpp_nsrI operator_namerMr+r; __class__s r rWCustomOp.__init__ws S M?+  %( 5=) " DF 7<4*.'rcUR(aeURRUR[ [ R "U55S5 SUlg)Nr,T)r_r[r>r?r r@rAr`s r %_register_autograd_kernel_indirection.CustomOp._register_autograd_kernel_indirectionsA???? t||%@tAT%UWab7;4rc nURU5(aBURUnUceURn[SUSURSUSUS3 5e[ R "[R"U55nURSUR3n[X%5URU'g)NzAttempting to register a z impl for operator z that already has a z impl registered from Python at z. This is not supported.:) _has_implr^locationrXr]r- getframeinfosys _getframefilenamelinenoFuncAndLocation)r`kindrG stacklevelfunc_and_locationrlframes r _register_implCustomOp._register_impls >>$   $ D 1 $0 00(11H+D61DT^^DTU&&*V+K*46  $$S]]:%>?nn%Qu||n5+D; Drc URU$Nr^r`rss r _get_implCustomOp._get_impls{{4  rcXR;$rzr{r|s r rkCustomOp._has_impls{{""rcU?[[RUR5n[ XR 5(a[XR 5 [UR grz) r[getattrropsrZhasattrr?delattrrQr])r` opnamespaces r _destroyCustomOp._destroysD Ieii6 ; - - K . DNN +rc"SURS3$)Nz)r]rfs r __repr__CustomOp.__repr__s/s33rcN[R"UR/UQ70UD6nU$rz)rB_dispatch_call_boxedr\)r`argskwargsrNs r __call__CustomOp.__call__s'((I$I&I r device_typesr$ct^^^[T[5(aT/mTHn[U5 M UUU4SjnU$)r&c>[T5H_nTRU5 TRXTS9 [Un[R "TR TRU5"U5 Ma U$)Nrt)set_check_doesnt_have_library_implrwSUPPORTED_DEVICE_TYPE_TO_KEYr7r>r[r?)f device_type dispatch_key _stacklevelrr`s r rOCustomOp.impl..innersa"<0 44[A##K{#K;KH  TYY lCAF 1 Hr) isinstancestrvalidate_device_type)r`rrrrOs``` r r> CustomOp.impls7 lC ( ((>L'K  -(  rcURU5(ag[Un[R"URU5(a[ SUSURS35eg)Nzimpl(..., device_types=z): the operator zs already has an implementation for this device type via a pre-existing torch.library or TORCH_LIBRARY registration.)rkrrB._dispatch_has_computed_kernel_for_dispatch_keyr]rX)r`rkeys r r(CustomOp._check_doesnt_have_library_implsj >>+ & & *;7 < TRSU5 [R"TRTRS5"U5 U$)Nfactory BackendSelect)rwr7r>r[r?)rr`s r rO$CustomOp.impl_factory..inners5    1 - LLDLL/ B1 EHrr)r`rOs` r impl_factoryCustomOp.impl_factorys   rc^^UU4SjnU$)r&c.>^^^TR5 TRSTTS9 TRS5RmTRm[ R "T5UUU4Sj5nTRRTRUS5 T$)Nabstractrc>UU4Sjn[RRRU5 T"U0UD6sSSS5 $!,(df  g=f)Nc&>[STST35e)Nz.inner..f_with_ctx..error_on_ctxs+&'j) 'Z)  r)r_library fake_implset_ctx_getter)rrrrrlr"s r f_with_ctx9CustomOp.impl_abstract..inner..f_with_ctxs< ^^--<<\Jd-f-KJJs A AMeta) $_check_doesnt_have_library_meta_implrwr}rlr]rDwrapsr[r>r?)rrrlr"rr`s` @@r rO%CustomOp.impl_abstract..inners}  5 5 7    A+  F~~j1::H~~H__Q  .  . IINN4<<V <Hrrr`rrOs`` r impl_abstractCustomOp.impl_abstracts  8 rc^^UU4SjnTRmTR5[R:waU"S5 TRnTR(dU"S5 [ U5S:de[ SU55nU(aU"S5 [[R5S[[R5S[[R5S [[R5S [[R5S [[[R5S5S 0nTRHEnURU;aMU"S [!UR#55SURS35 MG g)Nc@>[SUSTRST35e)NzCCannot use torch._custom_ops APIs to register backward formula for z. Got operator z with schema: )rXr])detailrIr`s r error4CustomOp._check_can_register_backward..errors1%ho>>".: rznon-functional operatorzoperator with no returnsrc3# UH4oRSL=(a URR(+v M6 g7frz) annotationis_write).0rs r 8CustomOp._check_can_register_backward..#s/# LPqLL $ BQ\\-B-B)B BDs<>zoperator that returns viewsintSymIntboolfloatTensorz List[Tensor]zoperator with return not in z (got ))rYrsr functionalreturnslenanyrrrrrrrrr0listvalues)r`rretsis_non_mutating_viewallowed_return_typesretrIs` @r _check_can_register_backward%CustomOp._check_can_register_backwards6  ;;=J11 1 + ,~~~~ , -4y1}}"# LP#   / 0 VZZ % V]] #X V[[ !6 V\\ "G V]] #X Xfmm,d 3^  >>Cxx// 06J6Q6Q6S1T0UU[\_\d\d[eefg h"rc<UR(ag[R"URS5(a[ SURS35eSHEn[R"URU5(dM+[ SURSUS35e g)NCompositeImplicitAutogradz3impl_backward/impl_save_for_backward: the operator a3 already has an implementation for this device type via a pre-existing registration to DispatchKey::CompositeImplicitAutograd.CompositeImplicitAutograd operators do not need an autograd formula; instead, the operator will decompose into its constituents and those can have autograd formulas defined on them.)r, AutogradCPU AutogradCUDAz; already has an Autograd kernel registered to DispatchKey::z vi a pre-existing torch.library or TORCH_LIBRARY registration. Please either remove those registrations or don't use the torch._custom_ops APIs)r_rB%_dispatch_has_kernel_for_dispatch_keyr]rX)r`rs r (_check_doesnt_have_library_autograd_impl1CustomOp._check_doesnt_have_library_autograd_impl7s  7 7  3 3DNND_ ` `EdnnEUV>?@ @?C77LL"$$(NN#342257YZ[[?rcURS5(ag[R"URS5(a'[R"URS5(dg[R"URS5(a[ SURS35e[R"URS5(a[ SURS35eg)NrCompositeExplicitAutogradrrz!impl_abstract(...): the operator a- already has an implementation for this device type via a pre-existing registration to DispatchKey::CompositeImplicitAutograd.CompositeImplicitAutograd operators do not need an abstract impl; instead, the operator will decompose into its constituents and those can have abstract impls defined on them.z already has an DispatchKey::Meta implementation via a pre-existing torch.library or TORCH_LIBRARY registration. Please either remove that registration or don't call impl_abstract.)rkrBrr]rXrfs r r-CustomOp._check_doesnt_have_library_meta_implOs >>* % %   4 4T^^E` a a<> " NN. / 4 4 NN: & + + - J/rc^^UU4SjnU$)ziRegister a function that tells us what to save for backward. Please see impl_backward for more details. c>TR5 TR5 TR(dTR5 TR SUTS9 TR S5(aTR 5 gg)Nrrr)rrr_rgrwrkr)rrr`s r rO.CustomOp.impl_save_for_backward..innersf  - - /  9 9 ;??::<    3Q;  O~~j))..0*rrrs`` r impl_save_for_backwardCustomOp.impl_save_for_backwards  1 rc^^^Tb|U4Sjn[T[5(dU"5 TH!n[U[5(aMU"5 M# [TRR 5[T5:waU"5 UUU4SjnU$)r&c >[ST35e)Nzimpl_backward(output_differentiability): expected output_differentiability to be a list of bools with length equal to the number of outputs of this CustomOp got: r)output_differentiabilitysr yell$CustomOp.impl_backward..yells""55788rc>TR5 TR5 TR(dTR5 TR SUTS9 TTlTR S5(aTR5 gg)Nrrr)rrr_rgrwrrkr)rrrr`s r rO%CustomOp.impl_backward..innersn  - - /  9 9 ;??::<    A+  F-ED *~~122..03r)rrrrrYr)r`rrrdiffrOs``` r impl_backwardCustomOp.impl_backwardsq $ / 86==0!$--F14<<''(C0H,II 1 r) r3rZr^r[r\r?rr]r_rY))Nr)r3r< __qualname____firstlineno__r=rWrgrwr}rkrrrtypingUnionrIterableCallabler>rrrrrrrrr__static_attributes__ __classcell__)rcs@r rrrsY^//4< <!# ,4RS"LLfooc.B)BC *Nfoo!foo!F#iJ[0"XR 0 rc>\rSrSr%\R \S'\\S'Srg)rrirGrlrN) r3r<rrrr__annotations__rrrrr rrrrs //MrrrrarbcURcSO URn[R"US[UR53U5$)NrU) overload_namerB_dispatch_find_schema_or_throwrr;)rarbrs r r:r:sN))1}7R7R  , , ("S++,-.  rrHcfSU;a[SUS35eU[;a[SUSUS35eg)N.zcustom_op(..., ns="zC"): expected ns to not contain any . (and be a valid variable name)zcustom_op(..., ns='z'): 'z9' is a reserved namespace, please choose something else. )r/ RESERVED_NS)rHs r r2r2sZ by!"&# $   [!"U2$/- .  rrIc[RRRU5(d[ SU35eUR R b[ SU35eg)Nzcustom_op only supports functional operators (ops that do not mutate any inputs, do not return views of the inputs, and has at least one return). Got the following non-functional schema: zUcustom_op does not support arguments named 'self'. Please rename your argument. Got: )rrutilsis_functional_schemar/ argumentsself_arg)rIs r r5r5sq >>   4 4V < <89?x A    ,**0 3  -rcURSS5n[U5S:wa[SUS35eSUS;a[SU35eUSUS4$) NrUr rz$Expected there to be a namespace in z;, i.e. The operator name should look something like ns::foorzThe torch.custom_ops APIs do not handle overloads, i.e. operator names with '.' in them. Please name your operator something like ns::foo. Got: r)splitrr/)r"namess r r1r1s~ NN4 #E 5zQ?zJLMN N eAh!"* ,- - 8U1X rrc`U[;a$[SUS[R5S35eg)NzCustomOp.impl(device_types=[z(, ...]): we only support device_type in r)rr/keys)rs r rrs?66*;-8.3356a 9  7rparamcUR[RR[RR4;$rz)rsr- ParameterPOSITIONAL_OR_KEYWORD KEYWORD_ONLY)rs r supported_paramr"s6 :://&& rrGc^^^^ [R"U5m [ST RR 555(d[ ST 35e[ ST RR 555(d'T R[RRLa[ ST 35eT RR 5VVs/sH2up#UR[RR:XdM/X#4PM4 nnnT RR 5VVs/sH2up#UR[RR:XdM/X#4PM4 nnnUU 4SjmUU 4SjmUU4SjnU"UTRR5 U"UTRR 5 gs snnfs snnf)Nc3<# UHup[U5v M g7frz)r"r_ps r r3validate_function_matches_schema..sE.Ddaq!!.Dszcustom_op(..., manual_schema)(func): positional-only args, varargs, and kwargs are not supported. Please rewrite `func` to not have them. Got `func` with signature: c3r# UH-upUR[RRLv M/ g7frz)rr-remptyr%s r rr(s. . LL 1 1 7 7 7.s57zcustom_op(..., manual_schema)(func): When passing in a manual schema, we expect `func` to have no type annotations to avoid ambiguity. Got `func` with signature: c&>[STST35e)Nzcustom_op(..., manual_schema)(func): When passing in a manual schema, we expect `func`'s signature to match `manual_schema` (aside from type annotations). func's signature: , manual_schema: r/rIsigsr r/validate_function_matches_schema..error)!"%%6vh @  rc&>[STST35e)Nzycustom_op(..., manual_schema)(func): neither func nor manual_schema should have default arguments. Got func's signature: r,r-r.sr error_default_args.error_default_args'r1rc>[U5[U5:waT"5 [X5H[uup#nX$R:waT"5 UR[R R LdURcMTT"5 M] grz)rzipr;defaultr-rr*)sig_args schema_argsr;rargrr3s r compare1validate_function_matches_schema..compare/se x=C , , G"%h"< MT3xx}}G$5$5$;$;;s{{?V"$ #=r)r- signatureall parametersitemsr/rreturn_annotation Signaturer*rsrr r!rflat_positionalflat_kwarg_only) rIrGr;r positional kwargonlyr;rr3r/s ` @@@r r6r6s   D !C Ecnn.B.B.DE E E<>//11KD ::**@@ @  1>>//11KD ::**77 7  1   % J((889 Iv''778K s.F> F>2.G$Grrc US:Xa[US35eUS:Xa[US35eUS;a'UR5n[USUSUSUS 35e[US US 35e) N Undefineda: There were no Tensor inputs to this operator (e.g. you passed an empty list of Tensors). If your operator is a factory function (that is, it takes no Tensors and constructs a new one), then please use CustomOp.impl_factory to register an implementation for itrz: when running with device='Meta' tensors: there is no abstract impl registered for this CustomOp. Please register one via CustomOp.impl_abstract to get this CustomOp to work with Meta tensors)rrz: when running with device='z' tensors: there is no zW impl registered for this CustomOp. Please register one via CustomOp.impl(device_type='z')z%: No implementation for dispatch key z. It is likely that we have not added this functionality yet, please either open an issue or if you're feeling adventurous, use the low-level torch.library API)NotImplementedErrorlower)rrdevices r rFrF<s k!k' (   f}!kT U   o!k5fX=Th**0 5   +:3%@  rc 4URn[RRUS5nUR 5R S5Sn[ UR5nUR S5Sn[R"U5n[X!XSUSS9$)Nr)rUTr*) namespacerr7r8r;rrrYrr4r)oprHrLr;rJrIs r custom_op_from_existingrPZs} B --  J /C 779??4  $DRZZJ!!$'+J  ! !* -F CV2t DDrc6^U4Sjn[T5up#[[RU5(dU"5 [ [RU5n[XC5(dU"5 [ XC5n[US5(dU"5 UR $)Nc">[STS35e)NzCould not find the operator z~. Please make sure you have already registered the operator and (if registered from C++) loaded it via torch.ops.load_library.r-)r"sr error_not_foundget_op..error_not_foundfs!*8*54 56 6rr7)r1rrrrr7)r"rSrHr;rpackets` r rresu6 h'HB 599b ! !%))R(K ; % % [ 'F 69 % % >>rcU[;a [U$U(d[SUS35e[U5n[U5nU$)NzCould not find custom op "z5". Did you register it via the torch._custom_ops API?)rQrXrrP)r"also_check_torch_libraryoverloadrNs r _find_custom_oprYxsQ?"x(( #( 3) *+ +hH $X .F MrcU[RRR;ag[RRRUnUcgUR S5(dgUR S5R $)Nr)r _custom_opr>rQrkr}rG)r"rs r get_abstract_implr\sou'',,<<<  %%55h?I   z * *   z * / //rc 0URS5up4UU3n[R"U5n[U5 U(a%[R R R/O/n[R"US5nURXWS9 [X6R5n [XXdU SS9n U R5 [R RU [ R""[$[&R("U 555 [+U5$)NrUr))tagsTr*)rrr4r5rrBTagneeds_fixed_stride_orderr7r8r9r:r;rrgrCrDrErFr@rAr) r"rIr`rHr;rJrKr^rLrMrNs r _custom_op_with_schemaras~~d#HB6&"J$**:6OO$6NEHHLL 1 1 2TVD //"j )CJJzJ%%b*>*>?H chPT UF 002 HH00)##$97==;PQ ( rrz)F)T)8 dataclassesrDr-rnrr@rtorchgen.modelrrrrrrrtorch._CrB torch.libraryr7r rr r torch._library.infer_schemar __all__rrr!rOptionalrrrQdictr r dataclassrrr:r2r5tupler1rrrr"r6AnyrFrPrrYr\rarrr rms __ !L"4 /    M:>33"(//#"63 __3x*,c:o&+~~B   3|  3  4   N t " S U38_  c d 7,,>9 >9"(//>9 >9BVZZcd<E& 0r