a hP @s2ddlZddlZddlmZmZmZddlZddlmm m m Z ddl mm m Zddlm Z ddlmZmZddlmZddlmZddlmZddlmZdd lmZmZejj ZGd d d ej Z!eeee"e#e$efe%e!e!fd d dZ&eee"e#e$efee%eej'e(feej'e)ffdddZ*eeedddZ+eee)dddZ,ee-e)dddZ.eee#dddZ/ee#edddZ0eddd d!Z1d"d#Z2e2ej'ej'ej'd$d%d&Z3e2ej'ej'ej'd$d'd(Z4e2ej'ej'ej'd$d)d*Z5ee6dd+d,Z7eee)ed-d.d/Z8dS)0N)CallableOptionalUnion)FakeQuantizeBase ObserverBase)_is_activation_post_process)getattr_from_fqn) GraphModule)Node)NSNodeTargetType NSResultsTypec@s4eZdZeZeZeZeZeZ dS)NodeInputOrOutputTypeN) __name__ __module__ __qualname__enumautoFP32INT8FP16UNKNOWNZ FP32_OR_INT8rrB/var/www/auris/lib/python3.9/site-packages/torch/ao/ns/fx/utils.pyrs r)nodegm logger_clsnode_type_to_io_type_mapreturncs|d}|d}|d}|d}|d}|d} |d} |d} |jd kr|j|vr`tjtjfS|j|vrvtjtjfS|j|vrtjtjfS|j|vrt||d } t| tsJt | |||\} }||fStj tj fSn|jd kr|jd ksJt|jt sJt ||jt fd d | D}t|ttfs@|rvt||d } t| ts\Jt | |||\} }||fSt fdd |D}t fdd | D}|rtjtjfS|rtjtjfStj tj fSn|jdkr|jdkr&t||d }t|ts Jt ||||\} }|tjfS|jdkrt||d }t|tsNJt ||||\} }t||d}|tjusJ|d|tjfS|j| vrt||d } t| tsJt | |||\} }||fStj tj fStj tj fSdS)NZfuns_io_type_fp32Zfuns_io_type_fp16Zfuns_io_type_int8Zfuns_io_type_fp32_or_int8Zmods_io_type_fp32Zmods_io_type_int8mods_io_type_fp32_or_int8Zmeths_io_type_fp32_or_int8 call_functionr call_modulec3s|]}t|VqdSN isinstance.0 target_typemodrr Nsz7get_node_first_input_and_output_type..c3s|]}t|VqdSr"r#r%r(rrr*asc3s|]}t|VqdSr"r#r%r(rrr*es call_method dequantizetor z handling needs to be added)optargetrrrrget_normalized_nth_inputr$r $get_node_first_input_and_output_typerstrranyrrtorchfloat16)rrrrZFUNS_IO_TYPE_FP32ZFUNS_IO_TYPE_FP16ZFUNS_IO_TYPE_INT8ZFUNS_IO_TYPE_FP32_OR_INT8ZMODS_IO_TYPE_FP32ZMODS_IO_TYPE_INT8MODS_IO_TYPE_FP32_OR_INT8ZMETHS_IO_TYPE_FP32_OR_INT8Z first_argZ_prev_node_input_typeZprev_node_output_type"is_known_fp32_or_int8_input_moduleZis_known_fp32_input_moduleZis_known_int8_input_module prev_nodeZcur_node_dtype_targetrr(rr1&s                            r1)rrrrcsFt||d}t|tsdS|d}dd}|jdkrz|jtjkrN|||ddS|jtjtj tj tj fvrv|||dd SdS|jd krBt|jt sJt ||jttjtjtjtjtjtjtjtjtjtjtjtjtjtjtjtjtj tj!tj"tj#tj$tjtj%tj&frj'j(fSt)fd d |D}|rBt*|||SdS) z{ Returns the qparams (scale, zero_point) of the first input to `node`, if they can be inferred from the graph. rNrcSslt|||}t|||}t|tr.t|jts2Jt|trHt|jtsLJt||j}t||j}||fSr")r0r$r r/r2r)rrZ scale_arg_idxZ zp_arg_idxZ scale_nodeZzp_nodeZ scale_objZzp_objrrr _get_scale_zp_from_function_argss    z@get_node_input_qparams.._get_scale_zp_from_function_argsr r r!c3s|]}t|VqdSr"r#r%Z module_objrrr*sz)get_node_input_qparams..)+r0r$r r.r/r4Zquantize_per_tensortoqaddZadd_relumulZmul_relur2rnnqZLinearZConv1dZConv2dnniqZ ConvReLU2dZConv3dZ BatchNorm2dZ BatchNorm3dZConvTranspose1dZConvTranspose2dZELUZ GroupNormZInstanceNorm1dZInstanceNorm2dZInstanceNorm3dZ LayerNormZ HardswishZ LeakyReLUZReLU6ZBNReLU2dZBNReLU3dZ ConvReLU1dZ ConvReLU3dZ LinearReLUZscaleZ zero_pointr3get_node_input_qparams)rrrr8r6r9r7rr<rrBsb         rB)rrrcCs|jdkrt||j}t|rt|jdks0Jt|jdtsDJ|jd}t|jts^Jt||j}t|rt|jdksJt|jdtsJ|jd}|S)a If node is not an observer, returns it. If node is an observer, navigates up the graph and returns the first parent which is not an observer. For example, graph: (node_non_obs), node = node_non_obs : returns node_non_obs graph: (node_non_obs -> obs0), node = obs0 : returns node_non_obs graph: (node_non_obs -> obs0 -> fq0), node = fq0 : returns node_non_obs r!r r) r.rr/rlenargsr$r r2rrZnode_objrrrreturn_first_non_observer_nodes     rFcCs*|jdkr&t||j}t|tjr&dSdS)aO Assumes that all non-param args occur first. Returns the number of non-param args expected for a node. For example, for F.linear(x, weight, bias) Returns 1, because x is a non-param arg and weight and bias are params. For lstm_mod(x, hid) Returns 2, because both x and hid are non-param args. r!r:r )r.rr/r$nnZLSTMrErrrget_number_of_non_param_argss    rH)rrcsptjdkrgSjdkrjjtjtjjjtjfvsPjtj tjjj tj fvrjfddt dD}|SdgS)a- Returns the indices of args of the node which we should attach loggers to, if input logging is enabled. For example, * for (x + y), returns [0, 1] * for (1 + y), returns [1] * for (x + 1), returns [0] * for (linear(x, w, b)) returns [0] * by default, returns [0] rr cs"g|]}tj|tkr|qSr)typerDr )r&irrr ?z4get_arg_indices_of_inputs_to_log..r:) rCrDr.r/r4r>ops quantizedoperatorr?range)rresultrrKr get_arg_indices_of_inputs_to_log,s  rScCsPd}|jdvrt|j}n0|jdkrLt|jts6Jt||j}t|}|S)z Returns a string representation of the type of the function or module pointed to by this node, or '' for other node types. )r r+r!)r.r4typenamer/r$r2r)rrr'Z target_modrrrget_target_type_strDs    rV)results model_namerc Cs|i}|D]j\}}d}|D]:}|D],\}}||kr,t|sHJ|dd}q,q,q,q |durn|||<q |||<q |S)a  Rekeys the layer name of a results dictionary to use node names from `model_name`. For example, transforms {'base_op_1_0': {'node_output': {'model_a': [{'ref_node_name': 'linear1', ...}]}}} into {'linear1': {'node_output': {'model_a': [{'ref_node_name': 'linear1', ...}]}}} Note: we cannot use these node names directly because they are not guaranteed to be consistent across models. This is why we extract the results first and rekey afterwards. NrZ ref_node_name)itemsvaluesrC) rWrXZ new_resultsZold_layer_nameresult_type_to_resultsZnew_layer_namemodel_name_to_resultsZcur_model_nameZlist_of_resultsrrr'rekey_logger_info_on_node_name_of_modelSs    r])rWrc Csd}|D]P}|D]>}|D],\}}t|dkr$|dddur$|}qRq$qXqq^q |r|D]`}|D]R}||}|D]<\}}||krqtt|D]}||d}|||d<qqqvqjdS)ay If `fqn` entries are filled in for one of the models in `results`, copies them over to any models which do not have them filled out. A common use case benefitting from this is comparing a model prepared by quantization to a quantized model. In this case, the model prepared by quantization would have `fqn` entries, and the quantized model would not. Nrfqn)rZrYrCrQ) rWZmodel_name_with_fqnsr[r\rXZ model_resultsZref_model_resultsrJr^rrrmaybe_add_missing_fqnszs(       r_csfddS)Nc s|^}}}t|trt|ts2t|trpt|trpg}t||D]*\}}||g|R}||i|q@|St|tjrt|tjr|jr|}|jr|}|j tj ks|j tj krdS||g|R}|i|Sr") r$tuplelistzipappendr4TensorZ is_quantizedr,Zdtypefloat) rDkwargsZa0Za1Za_otherrWZel0Zel1new_argsfinnerrrrjs( zGmaybe_dequantize_first_two_tensor_args_and_handle_tuples..innerr)rirrhr8maybe_dequantize_first_two_tensor_args_and_handle_tuplessrk)xyrcCs*t|}t||}dt||S)z Computes the SQNR between `x` and `y`. Args: x: Tensor or tuple of tensors y: Tensor or tuple of tensors Return: float or tuple of floats )r4Znormlog10)rlrmZPsZPnrrr compute_sqnrs rpcCs"t||d|dS)z Computes the normalized L2 error between `x` and `y`. Args: x: Tensor or tuple of tensors y: Tensor or tuple of tensors Return: float or tuple of floats r:)r4sqrtsumrlrmrrrcompute_normalized_l2_errors rtcCs(|dd}|dd}tjj||S)z Computes the cosine similarity between `x` and `y`. Args: x: Tensor or tuple of tensors y: Tensor or tuple of tensors Return: float or tuple of floats r )Zreshaper4rGZ functionalZcosine_similarityrsrrrcompute_cosine_similaritys  rvcCs4|jdkr0|jtjtjtjtjtjtjfvr0dSdS)Nr FT)r.r/r4r>r?rPcatstackrKrrrop_type_supports_shadowings  ry)rridxrcCs4z|j|dd}|durb|\}}t|t||ks8J|t|krN||WSt||WSnXt|jt|j|ks~J|t|jkr|j|WS|t|j}t|j|WSWnrty.t|jt|j|ksJ|t|jkr|j|YS|t|j}t|j|YSYn0dS)zu Given a node, gets the n'th input to that node, normalizing args and kwargs to the best of its ability. T)Znormalize_to_only_use_kwargsN)Znormalized_argumentsrCrarZrDrf RuntimeError)rrrzZnorm_args_and_kwargsZ norm_argsZ norm_kwargsZ kwargs_idxrrrr0s*   r0)9rrPtypingrrrr4Ztorch.ao.nn.intrinsic.quantizedZaorGZ intrinsicrOrAZtorch.ao.nn.quantizedr@Ztorch.nnZtorch.ao.quantizationrrZtorch.ao.quantization.observerrZtorch.ao.quantization.utilsrZtorch.fxr Ztorch.fx.graphr Zns_typesr r rNr=Enumrdictr2setr`r1rdreintrBrFrHrarSrVr]r_rkrprtrvboolryr0rrrrsb      " R   '"