o ‡ZŽh-Tã@säddlmZmZmZddlZddlmZddlmZm Z m Z m Z ddl m Z ddlmZmZmZmZddlmZddlmZmZmZdd lmZmZmZdd lmZd gZd ed e eefdefdd„Z!deded e eefddfdd„Z"deded e eeffdd„Z#dede eefd e eefdefdd„Z$dedede%fdd„Z&d ej'jde eeffd!d"„Z(d#d$„Z)de eefde ee*ffd%d&„Z+d'e ee*fde eefd(e,de ee ffd)d*„Z-d+eeefd,ed-ed ej.j/d.e e%ej.j/fd/e ee fd(e,defd0d1„Z0d+ed-ed ej.j/d.e e%ej.j/fd/e ee fd(e,ddfd2d3„Z1d+ed ej.j/d.e e%ej.j/fd4ed/e ee fd(e,deefd5d6„Z2d+ed ej'jd/e ee fd(e,fd7d8„Z3 d;d ed9e e%e4e%e5ffd(e,defd:d „Z6dS)<é)ÚAnyÚOptionalÚUnionN)Ú FakeTensor)Ú CUSTOM_KEYÚNUMERIC_DEBUG_HANDLE_KEYÚObserverOrFakeQuantizeÚQConfigMapping)ÚPrepareCustomConfig)Ú_create_obs_or_fq_from_qspecÚ_insert_obs_or_fqÚ _is_activation_post_process_nodeÚ _save_state)Ú QConfigAny)Ú EdgeOrNodeÚQuantizationSpecBaseÚSharedQuantizationSpec)ÚGraphÚ GraphModuleÚNode)ÚArgumentÚprepareÚ edge_or_nodeÚshared_with_mapÚreturncCs*||}||kr |St||ƒ}|||<|S)zûFind the root node for the sharing tree Args: edge_or_node: edge/node that we want to find the root shared_with_map: each edge/node points to the parent, the root node will points to itself Returns: root edge/node ©Ú_find_root_edge_or_node)rrÚparentÚroot©rúQ/var/www/auris/lib/python3.10/site-packages/torch/ao/quantization/pt2e/prepare.pyr#s   rrÚchildcCs t||ƒ}t||ƒ}|||<dS)zHMerge the subtree for `child` with `parent`, the order is important hereNr)rr!rZ root_parentZ root_childrrr Ú_union7s   r"ÚqspeccCs$t|tƒr|j}t|||ƒdSdS)aUpdate the `shared_with_map` based on the qspec, this applies the `SharedQuantizationSpec` configuration and established the relationship between `edge_or_node` with the edge/node that it is pointing to, we'll use this information in the end to get the group id N)Ú isinstancerrr")r!r#rrrrr Ú_update_shared_withCs ür%Úedge_or_node_to_qspeccCs2t|tƒr|j}t||ƒ}||}t|||ƒS|S)aUnwraps qspec to get the final root qspec (non SharedQuantizationSpec) if qspec is SharedQuantizationSpec (1). tries to find the root edge or node for the node that the qspec points to (2). recursively find the root qspec based on the qspec for the root node )r$rrrÚ_unwrap_shared_qspec)r#r&rZ sharing_withrrrr r'Ss   r'Úqspec_aÚqspec_bÚ attr_namecCs@t||ƒot||ƒot||ƒt||ƒkpt||ƒ ot||ƒ S©N)ÚhasattrÚgetattr)r(r)r*rrr Ú_has_same_attres ÿýür.ÚmodelcCsti}|jjD]1}t|dƒr7d|jvr7|jd}|j ¡D] \}}||f}|||<q|jdur7|}|j}|||<q|S)zPGet a map from EdgeOrNode to quantization spec based on annotations on the nodesÚmetaÚquantization_annotationN)ÚgraphÚnodesr,r0Zinput_qspec_mapÚitemsZ output_qspec)r/r&ÚnZqaZ input_to_nr#Ú input_edgeÚ output_noderrr Ú_get_edge_or_node_to_qspecos    €r8csXd‰||vr||}t|||ƒ‰ˆdur(t‡‡fdd„dDƒƒr*t|||ƒdSdSdS)zçUnion input edge with another edge or node, used in implicit sharing to point the current input edge to other user edges of the producer node, or the output of producer node since these are referring to the same Tensor Nc3s|] }tˆˆ|ƒVqdSr+)r.)Ú.0Úattr©Úinput_edge_root_qspecZ root_qspecrr Ú ‘s € ÿ ÿz)_union_input_edge_with..)ZdtypeZ is_dynamicZ quant_minZ quant_maxZqschemeZch_axisÚscaleZ zero_point)r'Úallr")r6r<rr&rr#rr;r Ú_union_input_edge_withs  þïr@cCs.dd„| ¡Dƒ}| ¡D]e\}}t|tjjƒr!|}t|||ƒq |}t|||ƒ}t|tƒs0J‚|\}}|j dj rlt|tƒrDt|tƒsMt d||f›ƒ‚|j D]} | |urWqP|| f} t ||| ||ƒqPt |||||ƒt|||ƒq d} i} | ¡D]}t||ƒ} | | vrŽ| | | <| d7} | | | |<q{| S)aMap from edge/node to the group ID, generated from quantization annotations, edge/node with the same group ID should use the same observer/fake_quant instance This is applying SharedQuantizationSpec configuration and map each edge/node to a group There is another implicit sharing that's built in the quantization, when we have the following: * op1 -> op2 * output of op1: int8_qspec * (op1 -> op2) input edge: int8_qspec we'll assume sharing between the output of op1 and input of (op1 -> op2) since these are the same Tensor. Figuring out the correct group ID for all edge/node is a standard union find problem: https://www.geeksforgeeks.org/introduction-to-disjoint-set-data-structure-or-union-find-algorithm/ Args: edge_or_node_to_qspec: Dictionary from edge_or_node to the qspec, derived from annotations Returns: edge_or_node_to_group_id: Dictionary from edge_or_node to group_id (int), all edge or node that belongs to the same group should have the same id Example: op2 -> cat1 -> cat2 op1 / / op3 edge_or_node_to_qspec: { op1: int8_qspec, op2: int8_qspec, (op1, cat1): int8_qspc, (op2, cat1): SharedQuantizationSpec((op1, cat1)), cat1: SharedQuantizationSpec((op1, cat1)), (op3, cat2): int8_qspec, (cat1, cat2): SharedQuantizationSpec((op3, cat2)), cat2: SharedQuantizationSpec((op3, cat2)), } edge_or_node_to_group_id = _get_edge_or_node_to_group_id(edge_or_node_to_qspec) edge_or_node_to_group_id: { op1: 1, op2: 1, (op1, cat1): 1, (op2, cat1): 1, cat1: 1, (op3, cat2): 1, (cat1, cat2): 1, cat2: 1, } # everything are in the same group because (cat1) and (cat1, cat2) are implicitly shared, which # connects the two sharing group around cat1 and cat2 op due to transitive sharing cSsi|]}||“qSrr)r9Úkrrr Ú Úsÿz1_get_edge_or_node_to_group_id..r1z=Expected input_edge to have type Tuple[Node, Node], but got: ré)Úkeysr4r$ÚtorchÚfxrr%r'Útupler0Zallow_implicit_sharingÚ ExceptionÚusersr@r)r&rrr#r7r6r<Úargr5ÚuserZarg_to_user_edgeZ cur_group_idÚedge_or_node_to_group_idrrrr Ú_get_edge_or_node_to_group_id¥s\5ÿÿ  ÿ û û  rMrLÚis_qatcCsJi}i}| ¡D]\}}||}||vrt|||ƒ||<||||<q|S)z¶Generates the EdgeOrNode to observer/fake_quant instances Makes sure that for EdgeOrNode that has the same group_id should have the same observer or fake quant instances )r4r )rLr&rNÚ obs_or_fq_mapZgroup_id_to_obs_or_fqrr#Zgroup_idrrr Ú_get_obs_or_fq_map#s ÿrPÚnoderJÚqconfigÚ named_modulesrOc CsXt|ttfƒr#g}|D]}t|||||||ƒ} | | ¡q t|ƒ|ƒSt|tƒs*|St|tƒs1J‚|} |} t| |ƒrD| jd} t| |ƒs:t| tƒsRJdt| ƒ›ƒ‚| |f} | |vr\| S|| } | durf| S|  | d¡}|durzt |ƒt | ƒkrz| S|j   ¡D]}t||ƒs‡q||j }t |ƒt | ƒkr˜|Sqt|jtƒs¡J‚t|| |||jƒ} | S)zk Given a `node` and an `arg`, inserts an input observer between `node` and `arg` if necessary. rz0expect original argument to be a Node, but got: N)r$ÚlistrGÚ-_maybe_insert_input_observer_for_arg_or_kwargÚappendÚtyperr ÚargsÚgetÚidrIrDÚtargetr2rr )rQrJrRr/rSrOrNZnew_arg_to_returnZ inner_argZ new_inner_argÚnew_argZ original_argr6Zinput_edge_obs_or_fqZarg_as_output_obs_or_fqZmaybe_obs_nodeZ maybe_obs_modrrr rU:sdù     ÿÿ þ ÿ  ÿ ÿrUc Csˆg}|jD]}t|||||||ƒ}| |¡q|jtjjjjks=|jtjjj jks=|jtjjj jks=t |j ƒdks=Jdƒ‚t |ƒ|_dS)a  If needed, inserts observers to the input args and kwargs of `node`. Note: modifies `node` inplace. For example, if cur_node needs an observer after prev_node, we change from prev_node -> cur_node To prev_node -> obs -> cur_node rz, expecting kwargs for aten op IR to be emptyN)rXrUrVr[rEÚopsZatenÚcloneÚdefaultZ zeros_likeZgeluÚlenÚkwargsrG) rQrRr/rSrOrNÚnew_argsrJr\rrr Ú&_maybe_insert_input_observers_for_nodeŽs& ù ÿrcr2cCs€||vr>||}t|||||ƒ}t|tƒrs    ÿÿ ÿ þÿþ ý ü ÿþ  ýÿ þ ý üÿÿ ÿ ÿ  þ$ ÿ  þ~ ÿ þý  ü ÿþýüû úù øTÿþýü ûú ù2ÿþýü ûú ùÿþ ý ü=üÿþýû