o ‡ZŽhÙ9ã@sbUddlmZddlmZddlmZmZmZddlZddl m Z m Z ddl m Z mZmZmZmZddlmZmZmZmZmZmZmZmZgd ¢Zd Zd Zd Zd ZdZ ej!j"eej!j#j$ededeej!j%eej&ededeej!j'eej!j(eej)ededei Z*de+d<d2dd „Z,d3d4d"d#„Z-d5d4d$d%„Z.d4d&d'„Z/d4d(d)„Z0d6d,d-„Z1gd.¢Z2d/e+d0<Gd1d„dƒZ3dS)7é)Ú annotations)Ú OrderedDict)ÚAnyÚCallableÚUnionNé)Údefault_weight_fake_quantÚFixedQParamsFakeQuantize)Ú_PartialWrapperÚ)default_fixed_qparams_range_0to1_observerÚ,default_fixed_qparams_range_neg1to1_observerÚdefault_placeholder_observerÚdefault_weight_observer)Údefault_quint8_weight_qconfigÚdefault_reuse_input_qconfigÚ%default_symmetric_qnnpack_qat_qconfigÚ!default_symmetric_qnnpack_qconfigÚget_default_qat_qconfigÚget_default_qconfigÚQConfigÚ QConfigAny)Úget_default_qconfig_mappingÚget_default_qat_qconfig_mappingÚQConfigMappingÚÚ object_typeÚmodule_name_regexÚ module_nameZmodule_name_object_type_orderÚ hardsigmoidZ hardsigmoid_ÚsigmoidZsigmoid_ÚtanhZtanh_z+dict[Union[Callable, str], _PartialWrapper]Ú_FIXED_QPARAMS_OP_TO_OBSERVERÚis_qatÚboolÚbackendÚstrÚversionÚintÚreturnrc Cs:|rt||ƒ}nt||ƒ}|rtnt}|dvrt|j|d}n|}t|jtd}tƒ |¡  dt ¡  t j j |¡  t j j|¡  t j j|¡  t j jj|¡  t j jj|¡  t j jj|¡  t j jj|¡  t j j|¡  t j jt¡}i}t ¡D](\} } | |vr|| } n|rˆtj| d} n| } t| |d} | || <|  | | ¡qr|S)zX Return the default QConfigMapping for the given quantization type and backend. )ZfbgemmÚx86)Ú activationÚweightZreshape)Úobserver)rrrrrr*r rÚ set_globalÚset_object_typerÚtorchÚnnZConvTranspose1dZConvTranspose2dZConvTranspose3dÚ functionalZconv_transpose1dZconv_transpose2dZconv_transpose3dZ layer_normZ LayerNormZPReLUrr!Úitemsr Z with_args) r"r$r&ÚqconfigZdefault_weightZqconfig_transposeZqconfig_layernormÚqconfig_mappingZ!fixed_qparams_observer_to_qconfigZfixed_qparams_opr,Zfixed_qparams_qconfigr*©r5úT/var/www/auris/lib/python3.10/site-packages/torch/ao/quantization/qconfig_mapping.pyÚ_get_default_qconfig_mapping=sL   ÿÿ     ô ÿr7r)cCó td||ƒS)a? Return the default QConfigMapping for post training quantization. Args: * ``backend`` (str) : the quantization backend for the default qconfig mapping, should be one of ["x86" (default), "fbgemm", "qnnpack", "onednn"] * ``version`` (int) : the version for the default qconfig mapping F©r7©r$r&r5r5r6r~s rcCr8)a@ Return the default QConfigMapping for quantization aware training. Args: * ``backend`` (str) : the quantization backend for the default qconfig mapping, should be one of ["x86" (default), "fbgemm", "qnnpack", "onednn"] * ``version`` (int) : the version for the default qconfig mapping Tr9r:r5r5r6r‹s rcCót}tdd|ƒS)z Return a QConfigMapping that uses `torch.ao.quantization.default_symmetric_qnnpack_qconfig` as the default QConfig. FÚqnnpack)rÚ1_get_default_qconfig_mapping_with_default_qconfig©Údefault_qconfigr5r5r6Ú&_get_symmetric_qnnpack_qconfig_mapping—óÿr@cCr;)z… Return a QConfigMapping that uses `torch.ao.quantization.default_symmetric_qnnpack_qat_qconfig` as the default QConfig. Tr<)rr=r>r5r5r6Ú*_get_symmetric_qnnpack_qat_qconfig_mapping¢rArBr?rcCsH|rt|ƒ}nt|ƒ}| |¡|j ¡D] }|tvr!| ||¡q|S)zX Return a QConfigMapping that uses the provided qconfig as the default QConfig. )rrr-Úobject_type_qconfigsÚkeysr!r.)r"r$r?r4Úpatternr5r5r6r=­s   €r=)Úglobal_qconfigrCÚmodule_name_regex_qconfigsÚmodule_name_qconfigsÚ&module_name_object_type_order_qconfigsz list[str]Ú_QCONFIG_STYLE_ORDERc@sneZdZdZd$dd„Zd%dd „Zd&d d„Zd'dd„Zd(dd„Zd)dd„Z d*dd„Z d+dd„Z e d,d!d"„ƒZ d#S)-raß Mapping from model ops to :class:`torch.ao.quantization.QConfig` s. The user can specify QConfigs using the following methods (in increasing match priority): ``set_global`` : sets the global (default) QConfig ``set_object_type`` : sets the QConfig for a given module type, function, or method name ``set_module_name_regex`` : sets the QConfig for modules matching the given regex string ``set_module_name`` : sets the QConfig for modules matching the given module name ``set_module_name_object_type_order`` : sets the QConfig for modules matching a combination of the given module name, object type, and the index at which the module appears Example usage:: qconfig_mapping = QConfigMapping() .set_global(global_qconfig) .set_object_type(torch.nn.Linear, qconfig1) .set_object_type(torch.nn.ReLU, qconfig1) .set_module_name_regex("foo.*bar.*conv[0-9]+", qconfig1) .set_module_name_regex("foo.*", qconfig2) .set_module_name("module1", qconfig1) .set_module_name("module2", qconfig2) .set_module_name_object_type_order("foo.bar", torch.nn.functional.linear, 0, qconfig3) r(ÚNonecCs*d|_tƒ|_tƒ|_tƒ|_tƒ|_dS)N)rFrrCrGrHrI©Úselfr5r5r6Ú__init__èsþþzQConfigMapping.__init__rFrcCs ||_|S)z3 Set the global (default) QConfig. )rF)rMrFr5r5r6r-ôszQConfigMapping.set_globalrúUnion[Callable, str]r3cCó||j|<|S)zà Set the QConfig for a given module type, function, or method name. If the QConfig for an existing object type was already set, the new QConfig will override the old one. )rC)rMrr3r5r5r6r.ûs zQConfigMapping.set_object_typerr%cCrP)aO Set the QConfig for modules matching the given regex string. Regexes will be matched in the order in which they are registered through this method. Thus, the caller should register more specific patterns first, e.g.:: qconfig_mapping = QConfigMapping() .set_module_name_regex("foo.*bar.*conv[0-9]+", qconfig1) .set_module_name_regex("foo.*bar.*", qconfig2) .set_module_name_regex("foo.*", qconfig3) In this example, "foo.bar.conv0" would match qconfig1, "foo.bar.linear" would match qconfig2, and "foo.baz.relu" would match qconfig3. If the QConfig for an existing module name regex was already set, the new QConfig will override the old one while preserving the order in which the regexes were originally registered. )rG)rMrr3r5r5r6Úset_module_name_regexs z$QConfigMapping.set_module_name_regexrcCrP)z¼ Set the QConfig for modules matching the given module name. If the QConfig for an existing module name was already set, the new QConfig will override the old one. )rH)rMrr3r5r5r6Úset_module_names zQConfigMapping.set_module_namerÚindexr'cCs||j|||f<|S)a- Set the QConfig for modules matching a combination of the given module name, object type, and the index at which the module appears. If the QConfig for an existing (module name, object type, index) was already set, the new QConfig will override the old one. )rI)rMrrrSr3r5r5r6Ú!set_module_name_object_type_order$s  þÿz0QConfigMapping.set_module_name_object_type_ordercCs‚|jjd}tD]4}|d|›7}t||ƒ}t|tƒr5t|ƒdkr5| ¡D]\}}|d|›d|›7}q%q|d|›7}q|dS)Nz (z rz z: z ))Ú __class__Ú__name__rJÚgetattrÚ isinstancerÚlenr2)rMÚoutputÚ style_nameZqconfigsÚkeyr3r5r5r6Ú__repr__3s  ÿzQConfigMapping.__repr__údict[str, Any]c CsHt|jtt|j ¡ƒtt|j ¡ƒtt|j  ¡ƒt dd„|j  ¡DƒiS)a? Convert this ``QConfigMapping`` to a dictionary with the following keys: "" (for global QConfig) "object_type" "module_name_regex" "module_name" "module_name_object_type_order" The values of this dictionary are lists of tuples. cSsg|] \}}g|¢|‘R‘qSr5r5)Ú.0ÚkÚvr5r5r6Ú Usÿz*QConfigMapping.to_dict..) Ú_GLOBAL_DICT_KEYrFÚ_OBJECT_TYPE_DICT_KEYÚlistrCr2Ú_MODULE_NAME_REGEX_DICT_KEYrGÚ_MODULE_NAME_DICT_KEYrHÚ'_MODULE_NAME_OBJECT_TYPE_ORDER_DICT_KEYrIrLr5r5r6Úto_dict@sÿûzQConfigMapping.to_dictÚ qconfig_dictcCs°|ƒ}t|vr| |t¡| tg¡D] \}}| ||¡q| tg¡D] \}}| ||¡q%| tg¡D] \}}| ||¡q6| t g¡D]\}}}}|  ||||¡qG|S)a[ Create a ``QConfigMapping`` from a dictionary with the following keys (all optional): "" (for global QConfig) "object_type" "module_name_regex" "module_name" "module_name_object_type_order" The values of this dictionary are expected to be lists of tuples. ) rcr-Úgetrdr.rfrQrgrRrhrT)ÚclsrjÚconfrr3rrrSr5r5r6Ú from_dict[s$ ÿÿÿzQConfigMapping.from_dictN)r(rK)rFrr(r)rrOr3rr(r)rr%r3rr(r)rr%r3rr(r) rr%rrrSr'r3rr(r)r(r%)r(r^)rjr^r(r)rVÚ __module__Ú __qualname__Ú__doc__rNr-r.rQrRrTr]riÚ classmethodrnr5r5r5r6rÉs      )r"r#r$r%r&r'r(r)r)r)r(r)r)r)r"r#r$r%r?rr(r)4Ú __future__rÚ collectionsrÚtypingrrrr/Z fake_quantizerr r,r r r r rr3rrrrrrrrÚ__all__rcrdrfrgrhr0Z Hardsigmoidr1rZSigmoidrZSoftmaxZTanhr r!Ú__annotations__r7rrr@rBr=rJrr5r5r5r6ÚsF (   ó  A