a h$@s@ddlmZddlZddlZddlmZddlmZmZm Z ddl m Z ddl m Z ddlmZddlmZdd lmZmZmZmZdd lmZdd lmZGd d d eZeZeeddZeeddZ ej!ddZ"eej#e eddeej$ddZ%ddZ&eddZ'ddZ(ddZ)d d!Z*dS)")contextmanagerN) DispatchKey)_ConstantFunction flat_apply to_graphable strict_mode)autograd_not_implemented)HigherOrderOperator)FakeTensorMode)get_proxy_slotPreDispatchTorchFunctionModeProxyTorchDispatchModetrack_tensor_tree)_pytree)"is_traceable_wrapper_subclass_typecs(eZdZfddZfddZZS)ExportTracepointcstddS)N_export_tracepoint)super__init__)self __class__D/var/www/auris/lib/python3.9/site-packages/torch/_export/wrappers.pyrszExportTracepoint.__init__cstj|i|SN)r__call__)rargskwargsrrrrszExportTracepoint.__call__)__name__ __module__ __qualname__rr __classcell__rrrrrs rcOs<t|jj||f\}}|jdt||}t||d|jdS)N call_functionZconstanttracer)pytreeZtree_mapr%Z unwrap_proxy create_proxyrr)moderrZp_argsZp_kwargsproxyrrrexport_tracepoint_dispatch_mode%s r*cOs,||WdS1s0YdSrr)r(rrrrr"export_tracepoint_fake_tensor_mode.sr+cOsR||}||}|"t|i||WdS1sD0YdSr)Zunwrap_tensorsZredispatch_to_nextr)ctxrrZunwrapped_argsZunwrapped_kwargsrrrexport_tracepoint_functional4s    r-T)Zdeferred_errorcOs|Srr)rrrrrexport_tracepoint_cpuCsr.cst|tjjsJdksJtjj|}fddddfdd}fdd }|j|d d }|j|d d }||fS) NcsB|vr0|d|ksJ|d|ks0J||d|<dS)Nin_specout_spec)r0r1r)pathr0r1)module_call_specsrrupdate_module_call_signaturesMsz6_wrap_submodule..update_module_call_signaturescSs:|D]0}t|tjttttfs|dustd|qdS)NzGOnly Tensors or scalars are supported as pytree flattened inputs, got: ) isinstancetorchTensorstrintfloatboolAssertionError) flat_argsarrrcheck_flattenedSs z(_wrap_submodule..check_flattenedcsBt||f\}}|t|dd}t||\}}||fS)NZmodule_call_inputskindr2r& tree_flattenrZtree_unflatten)modulerrr=r0)r?r2rrpre_hookZs z!_wrap_submodule..pre_hookcsPt||f\}}t|\}}|t|dd}||t||S)NZmodule_call_outputsr@rB)rDrrres_r0Zflat_resr1)r?r2r4rr post_hookas  z"_wrap_submodule..post_hookT)Z with_kwargs) r5r6nnModuleZfxZ graph_moduleZ _get_attrZregister_forward_pre_hookZregister_forward_hook)modr2r3 submodulerErHZ pre_handleZ post_handler)r?r3r2r4r_wrap_submoduleHs  rMc csVg}z8|D]}|t|||q dVW|D] }|q.n|D] }|qB0dSr)extendrMremove)fZpreserve_signatureZmodule_call_signaturesZhandlesr2handlerrr_wrap_submodulesns rRcCsdd}||_|S)NcWs t||Srr)rrrrrcall|sz'_mark_strict_experimental..call)r)clsrSrrr_mark_strict_experimental{srUcCs`|d}t|j|r8t|j||ks(J|d|diS||}t|j|||d|diS)a This is a wrapper utility method on top of tracer to cache the already registered subclass spec attribute. This is useful because Subclass.__init__ will be same for each subclass. By default, fx will create multiple attributes/proxies for given attribute. 0get_attrr)hasattrrootgetattrr'get_fresh_qualnamesetattr)r%namespecZfx_namequalnamerrr'_register_subclass_spec_proxy_in_tracers  r`cs2dd}|s"tdjdfdd}|S)a) Experimental decorator that makes subclass to be traceable in export with pre-dispatch IR. To make your subclass traceble in export, you need to: 1. Implement __init__ method for your subclass (Look at DTensor implementation) 2. Decorate your __init__ method with _mark_constructor_exportable_experimental 3. Put torch._dynamo_disable decorator to prevent dynamo from peeking into its' impl Example: class FooTensor(torch.Tensor): @staticmethod def __new__(cls, elem, *, requires_grad=False): # ... return torch.Tensor._make_subclass(cls, elem, requires_grad=requires_grad) @torch._dynamo_disable @mark_subclass_constructor_exportable_experimental def __init__(self, elem, ...): # ... cSst|o|jdkS)Nr)callabler)fnrrr_is_initszCmark_subclass_constructor_exportable_experimental.._is_initztorch._export.wrappers.mark_constructor_exportable_experimental can only be applied on subclass tensor.__init__But, you are adding it on z which is not supported. If __init__ doesn't exist on your subclass, please add it. Look at DTensor.__init__ implementation for examplecstt|dsDjds Jjdtd }td|d|i|tjs`dStj }dd|D}t|dksJdt|t|dkrdS|d}|j |d}t t |dd|f\}}d jd } | } tj| |d | d i} ttjfd d|} tjjtt|\} }t|jd}t||}dt|| g| Ri}t||dddS)Nrrz5Applying mark_constructor_exportable_experimental on z is not valid as it is not a traceable tensor subclass. Please look at DTensor.__init__ implementation as an example of proper usage of this API.cSsg|]}t|tr|qSr)r5r ).0r(rrr s zVmark_subclass_constructor_exportable_experimental..wrapper..z6Expected only one PreDispatchTorchFunctionMode, found rG.rWrcs t|jSr)r r))xr%rrzTmark_subclass_constructor_exportable_experimental..wrapper..Z_const_func_specr#r$) rtyper!endswithlen RuntimeErrorr6Z_CZ_is_torch_function_mode_enabledZ overridesZ _get_current_function_mode_stackr%rtuplejoinlowersplitr[r\rYr'r&Z tree_map_onlyr7utilsrrCrrr`rr)rrZobj_nameZtorch_function_mode_stackZpre_dispatch_tf_modesr(subclassr=r0Zconstructor_spec_namer_Z spec_proxyZflat_proxy_argsrGZ func_specZ!fxable_constructor_call_spec_nameZfunc_spec_proxyZ inner_proxyconstructor_subclassrirwrappers`          zBmark_subclass_constructor_exportable_experimental..wrapper)ror)rwrcrxrrvr1mark_subclass_constructor_exportable_experimentals Gry)+ contextlibrr6Ztorch._custom_opsZtorch._CrZ"torch._higher_order_ops.flat_applyrrrZ#torch._higher_order_ops.strict_moderZtorch._higher_order_ops.utilsr Z torch._opsr Ztorch._subclasses.fake_tensorr Z"torch.fx.experimental.proxy_tensorr r rrZ torch.utilsrr&Ztorch.utils._python_dispatchrrrZpy_implr*r+Zpy_functionalize_implr-ZAutogradZCPUr.rMrRrUr`ryrrrrs<              &