o Zh| @sddlmZmZmZddlZddlmZddlmZddl m Z ddl m Z m Z mZddlmZgdZed d d e d ed ededef ddZed d GdddeZed d  dd e deeejddfddZed d de defddZed d d e de defddZdS))Any NamedTupleOptionalN) compatibility)Graph) GraphModule)map_argNodeTarget) ShapeProp)replace_target_nodes_with size_bytesget_size_of_all_nodesget_tensor_metaget_size_of_nodeF)Zis_backward_compatible fx_moduleold_op old_targetnew_op new_targetc st}i|jjD]G}|j|krD|j|krDt|jfdd}t|jfdd}t|t s0Jt|t s7J| |||||j |<q | |fdd|<q ||_dS)zModifies all nodes in fx_module.graph.nodes which match the specified op code and target, and updates them to match the new op code and targetc|SNnZval_maprQ/var/www/auris/lib/python3.10/site-packages/torch/fx/passes/graph_manipulation.py#z+replace_target_nodes_with..crrrrrrrr$rcrrrrrrrr+rN)rgraphnodesoptargetrargskwargs isinstancetupledictZ create_nodenameZ node_copy) rrrrrZ new_graphnoder#r$rrrr s     r c@seZdZUeed<eed<dS)r output_size total_sizeN)__name__ __module__ __qualname__int__annotations__rrrrr /s  r r#returncCsD|dur t|j||jjD]}|jdkrdSt|||_qdS)zGiven a fx graph module, update each node with its total size (weights + bias + output) and its output_size(output). For a non-module node, the total size is the output size. return total sizeNoutput)r propagaterr r!rr )rr#r)rrrr5s  rr)cCs$|jd}|std|d|S)N tensor_metazNode zQ has no tensor metadata associated with it! Check that shape propagation has run.)metaget RuntimeError)r)r4rrrrGs  rc Csd}|jdkr#t|}||j}|}|D] \}}||7}qt|}|j} || 7}|jr>t j g|j d } n t j g|j d } | |} | | } t| | S)zGiven a node with node.dtype and node.shape, return its total size and its output size. total_size = weights + bias + output_size rZ call_module)dtype)r!r'Z named_modulesr"Znamed_parametersZnumelrshapeZ is_quantizedtorchZ_empty_affine_quantizedr8Z element_sizeZtensorr ) rr)Ztotal_num_of_elemsZsubmodule_dict submodule parameters_namepr4Z output_elemZsize_per_elem_bytesr+r*rrrrTs(      rr)typingrrrr:Ztorch.fx._compatibilityrZtorch.fx.graphrZtorch.fx.graph_modulerZ torch.fx.noderr r Ztorch.fx.passes.shape_propr __all__strr r listZTensorrrrrrrrsF