a h+@sTddlZddlZddlmZddlmZddlmZmZm Z ddl Z ddl Z ddl m Z ddlmZgdZe ee jee jfZe e jefZee jjZee jjZeeZhdZe d d d d Ze d d eee jj fe jjed ddZ!e d d e jje"dddZ#e d d GdddZ$e d d e jj%e jj%dddZ&dS)N)Mapping) dataclass)AnyOptionalUnion) compatibility)_get_qualified_name)get_acc_ops_nameget_node_targetis_node_output_tensorFxNetAccFusionsFinderlegalize_graph>Z call_method call_function call_moduleF)Zis_backward_compatiblecCsTt|tr|S|jr*d|jvr*d|jS|jdd}|r@|ndd|jSdS)Nacc_opsacc_ops.z torch._opsz torch.ops.) isinstancestr __module____name__replace)kmodulerJ/var/www/auris/lib/python3.9/site-packages/torch/fx/passes/tools_common.pyr s  r ) submodulesnodereturncCs|jtvs(Jddtd|j|jdkrdt|jtsBJ||j}t|dt|}t|S|jdkr|j}|j durd|j vrd |j St |St|jtsJ|jSdS) a, Given a `node` returns its target typename. For "call_method" node, return node.target which is the name of that method being called. This could potential lead to conflict but should be okay because normally it's on a tensor. For "call_function" node, return typename of node.target. For "call_module" node, return typename of the module that node.target point to. If seeing "_VariableFunctionsClass" in the target name string, it will be replaced by "torch". e.g. _VariableFunctionsClass.relu would become torch.relu. zExpect op types of z, z , but found rZ_base_class_originrNrr) opCALLABLE_NODE_OPSjoinrtargetrgetattrtyper rrr)rrZsubmodZ submod_typer#rrrr +s$    r )rrcCs"|jdd}|duo t|tjS)aChecks if the node output produces a Tensor or not. NOTE: This requires to run `ShapeProp` on the containing fx graph before calling this function. This is because it works by checking the `type` metadata on the node. This metadata is produced by the `ShapeProp`. r%N)metaget issubclasstorchTensor)rtype_rrrr Rsr c@speZdZdZejjedddZe GdddZ dde ee fe ed d d Zeejjefd d dZdS)r z Finds groups of connected ACC nodes that pass non-tensor data between each other. Such groups are called fusion groups. )r acc_nodescCs||_t|jj|_||_dSN)rlistgraphnodesr,)selfrr,rrr__init__eszFxNetAccFusionsFinder.__init__c@s6eZdZUeed<eed<eed<eed<ddZdS)!FxNetAccFusionsFinder.FusionGroup top_node_idxr0inputsnodes_need_processcsR|jvrdSj|j|j|jfdd|jDdS)z5 Add a node to fusion group. Ncs$h|]}|jtvr|jvr|qSr)r r!r0).0nr1rr sz=FxNetAccFusionsFinder.FusionGroup.add_node..)r0r6addr5discardupdateall_input_nodes)r1rrr9radd_nodexs     z*FxNetAccFusionsFinder.FusionGroup.add_nodeN)rr __qualname__int__annotations__NodeSetr?rrrr FusionGroupjs rDNr3) fusion_groupr5visitedcCsz|D]p}|dur$||vrq|||jtvr0q|j||jkrDq||jvrTdS|||j|r||dSqdS)z Start from inputs and going reverse topological order. If any upstream node is in the fusion group, add all the nodes in this path to fusion group. NTF) r;r r!r0indexr4recursive_add_noder>r?)r1rEr5rFargrrrrHs     z(FxNetAccFusionsFinder.recursive_add_node)rcCsi}t|j}|D]l}||vr"q|jtvr.qd|jvr:q||jvrFq|j|j||ht|j |hd}|j rD|j }|j ||j tdd|jvr|jD]:}|jtvrq||jvrq|||j ||j tdq|j D]^}|jtvrqd|jvrq||jvr q||t|j|j||_|j ||j tdqqjt|j|jksh|j|j8_q|jD]}|j||<qnq|S)NZ tensor_meta)r4r0r5r6)rF)r.r,r r!r&rDr0rGsetr>r6poprHr5usersr?minr4)r1resultr,rrEuserrIr8rrr__call__sr                   zFxNetAccFusionsFinder.__call__)N)rrr@__doc__r)fx GraphModulerCr2rrDrNodeListrrHdictNoderPrrrrr ^s#  &r )gmrcstjtjtjtjtjtjtjtjtj tj tj tj t jjjjt jjjjt jjjjt jjjjt jjjjg}t|jjdt j}|jjD] }|jD]}|d7<qqt}|jjD]}|dkr| |qit!|dkrd|"}|#|fdd|<|jD]R}|d8<|dkr|j$dkrT|j%|vrT|&|n | |qqt!|jt!|jjkrt'dfddD|jj(|_(||_|S) a Replace the graph of the given GraphModule with one that contains the same nodes as the original, but in topologically sorted order. This is used by the merge_matmul transformation below, which disturbs the topologically sorted order of its input GraphModule, so that this order is restored before further transformation. Arguments: gm: The graph module to topologically sort. It is modified in-place. Returns: The graph module in-place sorted rcs|Sr-r)x)envrr/z legalize_graph..rz&Input graph has cycles, unable to add csg|]}|dkr|qS)rr)r7r)indegrr ;r\z"legalize_graph..))operatorr;mulsubfloordivtruedivmodleltgegteqner)opsZatenZsym_constrain_rangedefaultZsym_constrain_range_for_sizeZ _assert_asyncmsgZ scalar_tensorZ_assert_scalarrUfromkeysr/r0rRZGraphrL collectionsdequeappendlenpopleftZ node_copyr r# appendleft RuntimeErrorZ_codegen)rWZPRIORITIZED_OPSZ new_graphrrOqueuecurr)rZr]rr sX              r )'ror_collections.abcrZ dataclassesrtypingrrrr)Ztorch.fxZtorch.fx._compatibilityrZ torch.fx.noder__all__tupler*r.ZTensorsZTensorOrTensorsrRrVrTrJrCrZNamesr!r nnModuler boolr r rSr rrrrs8       &