a h|@sddlmZmZmZddlZddlmZddlmZddl m Z ddl m Z m Z mZddlmZgdZed d e eeeed d d Zed d GdddeZed d de eeejddddZed d e edddZed d e e edddZdS))Any NamedTupleOptionalN) compatibility)Graph) GraphModule)map_argNodeTarget) ShapeProp)replace_target_nodes_with size_bytesget_size_of_all_nodesget_tensor_metaget_size_of_nodeF)Zis_backward_compatible) fx_moduleold_op old_targetnew_op new_targetc st}i|jjD]}|j|kr|j|krt|jfdd}t|jfdd}t|t s`Jt|t snJ| |||||j |<q| |fdd|<q||_dS)zModifies all nodes in fx_module.graph.nodes which match the specified op code and target, and updates them to match the new op code and targetcs|SNnZval_maprP/var/www/auris/lib/python3.9/site-packages/torch/fx/passes/graph_manipulation.py#z+replace_target_nodes_with..cs|Srrrrrrr$rcs|Srrrrrrr+rN)rgraphnodesoptargetrargskwargs isinstancetupledictZ create_nodenameZ node_copy) rrrrrZ new_graphnoder"r#rrrr s   r c@seZdZUeed<eed<dS)r output_size total_sizeN)__name__ __module__ __qualname__int__annotations__rrrrr /s r )rr"returncCsB|durt|j||jjD]}|jdkr0q>t|||_qdS)zGiven a fx graph module, update each node with its total size (weights + bias + output) and its output_size(output). For a non-module node, the total size is the output size. return total sizeNoutput)r propagaterrr rr )rr"r(rrrr5s  r)r(r0cCs$|jd}|s td|d|S)N tensor_metazNode zQ has no tensor metadata associated with it! Check that shape propagation has run.)metaget RuntimeError)r(r3rrrrGs   r)rr(r0c Csd}|jdkrFt|}||j}|}|D]\}}||7}q0t|}|j} || 7}|jr|t j g|j d } nt j g|j d } | |} | | } t| | S)zGiven a node with node.dtype and node.shape, return its total size and its output size. total_size = weights + bias + output_size rZ call_module)dtype)r r&Z named_modulesr!Znamed_parametersZnumelrshapeZ is_quantizedtorchZ_empty_affine_quantizedr7Z element_sizeZtensorr ) rr(Ztotal_num_of_elemsZsubmodule_dict submodule parameters_namepr3Z output_elemZsize_per_elem_bytesr*r)rrrrTs$      r)N)typingrrrr9Ztorch.fx._compatibilityrZtorch.fx.graphrZtorch.fx.graph_modulerZ torch.fx.noderr r Ztorch.fx.passes.shape_propr __all__strr r listZTensorrrrrrrrs4