o ‡ZŽh¯ã@s¤ddlZddlZddlZddlmZddlmZddlmZdej de ej de ej dffd d „Z dd ed ede fdd„Zde efdd„Zdejjfdd„ZdS)éN)Úsymbolic_trace)ÚNode)Úlegalize_graphÚresultÚinputsÚreturn.cCs8t|tjjƒrdgt|ƒ}ndd„|Dƒ}t ||¡S)a‰ A free function for use in the merge_matmul graph transformation below that splits the output from a merged matmul into the individual results for each input tensor. Arguments: result: The merged matmul result tensor. inputs: The list of inputs that were merged into one for the matmul. Returns: List of matmul results for each input tensor. rcSóg|]}|jd‘qS©r)Úshape)Ú.0Úx©r úQ/var/www/auris/lib/python3.10/site-packages/torch/fx/experimental/merge_matmul.pyÚ óz(split_result_tensors..)Ú isinstanceÚtorchZfxZProxyÚlenÚsplit)rrZsplitsr r rÚsplit_result_tensors s réÚaÚbÚ search_depthcCsP||krdSt|jƒdkrdS|dkrdS|jD] }t|||dƒr%dSqdS)a^ Determine if one node depends on another in a torch.fx.Graph. Arguments: a: The node that may have a dependency on b. b: The node that a may have a dependency on. search_depth: In the case of an indirect dependency, this function searches upto this many nodes away in search of a data dependency. If none is found, the function makes the conservative assumption that there is a dependency. Returns: True if a may depend on b, False if it definitely does not. TrFé)rZall_input_nodesÚ may_depend_on)rrrÚinpr r rr$s ÿrÚnodescCs4t |d¡D]\}}t||ƒst||ƒrdSqdS)zØ Check if all of the given nodes are pairwise-data independent. Arguments: nodes: The nodes to check for data dependencies. Returns: True if any pair in nodes has a data dependency. éFT)Ú itertoolsÚ combinationsr)rÚiÚjr r rÚare_nodes_independentIs  ÿr#Úin_modc s’t|ƒ‰i}i}ˆjjD]9}|jdks|jtjurq |j\}}|jdkr'|jn|}|jdkr1|jn|}| |g¡  |¡| |g¡  |¡q |  ¡D]s\}}t |ƒdkrUqJt |ƒsZqJdd„|Dƒ}‡fdd„|Dƒ}t |tƒruˆj |¡n|}ˆj tj|fi¡}ˆj tj||fi¡} ˆj t| |fi¡‰‡‡fdd„tt |ƒƒDƒ} t|| ƒD]\} } |  | ¡ˆj | ¡q©tˆƒqJˆ ¡ˆj ¡ˆS)aÚ A graph transformation that merges matrix multiplication operations that share the same right-hand side operand into one large matrix multiplication. ____ _________ _________ ---- | | | | M| A * C | M| A | T| B | * K| C | = |---------| ---- , | | | | T| B * C | K ---- --------- --------- K R R Ú call_functionÚget_attrrcSrr )Úargs)r Úmmr r rr†rz merge_matmul..cs&g|]}t|tƒrˆj |¡n|‘qSr )rÚstrÚgraphr&)r Úl)Úgmr rrŠs&cs"g|] }ˆj tjˆ|fi¡‘qSr )r*r%ÚoperatorÚgetitem)r Úout©r,Zmerge_mm_splitr rr¡sÿÿ)rr*rÚopÚtargetrÚmatmulr'Ú setdefaultÚappendÚitemsrr#rr)r&r%ÚcatrÚrangeÚzipZreplace_all_uses_withZ erase_noderZ recompileZlint) r$Z rhs_usersZ lhs_usersÚnodeÚlhsÚrhsÚmmsZlhs_valsZ merge_mm_catZmerge_mmZ merge_mm_resÚoldÚnewr r0rÚ merge_matmul[sP    þú ÿ  þ   r@)r)rr-rZtorch.fx._symbolic_tracerZ torch.fx.noderZtorch.fx.passes.tools_commonrZTensorÚlistÚtuplerÚintrr#ÚnnÚModuler@r r r rÚs    ÿÿ  þ%