o Zhn @slddlZddlmZmZddlmZmZmZmZm Z m Z m Z ddl Z ddl mZmZmZddlmZmZmZddlmZerFdd l mZmZeeZerpdd lmZmZmZm Z m!Z!m"Z"m#Z#m$Z$m%Z%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+erdd lm,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4esese5d dd de6dee6dee6eegefffddZ7GdddZ8dS)N)partialreduce) TYPE_CHECKINGCallableDictOptionalTupleTypeUnion)PretrainedConfigis_tf_availableis_torch_available)TF2_WEIGHTS_NAME WEIGHTS_NAMElogging) OnnxConfigPreTrainedModelTFPreTrainedModel) AutoModelAutoModelForCausalLMAutoModelForImageClassificationAutoModelForImageSegmentationAutoModelForMaskedImageModelingAutoModelForMaskedLMAutoModelForMultipleChoiceAutoModelForObjectDetectionAutoModelForQuestionAnswering AutoModelForSemanticSegmentationAutoModelForSeq2SeqLM"AutoModelForSequenceClassificationAutoModelForSpeechSeq2SeqAutoModelForTokenClassificationAutoModelForVision2Seq) TFAutoModelTFAutoModelForCausalLMTFAutoModelForMaskedLMTFAutoModelForMultipleChoiceTFAutoModelForQuestionAnswering"TFAutoModelForSemanticSegmentationTFAutoModelForSeq2SeqLM$TFAutoModelForSequenceClassification!TFAutoModelForTokenClassificationzThe ONNX export features are only supported for PyTorch or TensorFlow. You will not be able to export models without one of these libraries installed.onnx_config_clssupported_featuresr0returncGsz|durtdt}|dD]}t||}qi}|D]}d|vr1|dd}t|j|d||<qt|j|d||<q|S)ac Generate the mapping between supported the features and their corresponding OnnxConfig for a given model. Args: *supported_features: The names of the supported features. onnx_config_cls: The OnnxConfig full name corresponding to the model. Returns: The dictionary mapping a feature to an OnnxConfig constructor. Nz#A OnnxConfig class must be provided. -with-past)task) ValueError transformerssplitgetattrreplacerZ with_pastZfrom_model_config)r0r1Z config_clsZ attr_namemappingfeaturer6r>I/var/www/auris/lib/python3.10/site-packages/transformers/onnx/features.pysupported_features_mapping7s   r@c@sPeZdZiZiZereeee e e e e eeeeeeedZer,eeeeeeeeed Zidedddddd d d d edd dddddd dd dedddd deddddddd dd deddddddd dd dedd dddddd dd dedd dddddd dedd dddddd d edd ddddd!d d"eddddddd d#d d$edd%d d&eddd'd d(edddddd d)d d*eddd+d d,edddddd d-d d.eddd/d d0eddddd d1d id2edddddd d3d d4eddd5d d6edd7d8d9d d:edddddd d;d deddddddd d?d d@edd dddddAd dBedd ddd ddCd dDedd ddddEd dFeddGd dHedddddd dId dJedddKd dLedddddMd dNedd dddOd dPedddQd dRedd dddSd dTedddd dddUd idVedd dddddWd dXedd dddddd dYd dZedddddd d[d d\eddd]d d^eddd_d d`edddad dbedd dddcd ddedd ddded dfeddgd dheddddid djedddkd dleddddddd dmd dnedddod dpeddddddd dqd dreddddddd ddsd dtedddudvd dwedddddd dxd edddyd edd dddzd ed{d|d eddd}d edd d~ddd eddddddd dd eddddddd dd edd7dd dZ e!e"dddde #DZ$e% dde&de'e&de(e&e)e*ge+fffddZ,e%de&de&fddZ-e%de&fddZ.e%dde&de&de/fddZ0e%dde&de'e&de&fddZ1e% dde&de&de'e&de'e&de2df ddZ3e% dde2dde&de4e&e)ffddZ5de&de&de+fddZ6dS)FeaturesManager)default masked-lm causal-lm seq2seq-lmsequence-classificationtoken-classificationmultiple-choiceobject-detectionquestion-answeringimage-classificationimage-segmentationz masked-imsemantic-segmentation vision2seq-lm speech2seq-lm) rBrCrDrErFrGrHrJrMZalbertrBrCrFrHrGrJzmodels.albert.AlbertOnnxConfigr/Zbartzdefault-with-pastrDzcausal-lm-with-pastrEzseq2seq-lm-with-pastzmodels.bart.BartOnnxConfigZbeitrKzmodels.beit.BeitOnnxConfigZbertzmodels.bert.BertOnnxConfigzbig-birdz!models.big_bird.BigBirdOnnxConfigzbigbird-pegasusz/models.bigbird_pegasus.BigBirdPegasusOnnxConfigZ blenderbotz&models.blenderbot.BlenderbotOnnxConfigzblenderbot-smallz1models.blenderbot_small.BlenderbotSmallOnnxConfigZbloomzmodels.bloom.BloomOnnxConfigZ camembertz$models.camembert.CamembertOnnxConfigZclipzmodels.clip.CLIPOnnxConfigZcodegenz models.codegen.CodeGenOnnxConfigZconvbertz"models.convbert.ConvBertOnnxConfigZconvnextz"models.convnext.ConvNextOnnxConfigz data2vec-textz&models.data2vec.Data2VecTextOnnxConfigzdata2vec-visionz(models.data2vec.Data2VecVisionOnnxConfigZdebertaz models.deberta.DebertaOnnxConfigz deberta-v2z%models.deberta_v2.DebertaV2OnnxConfigZdeitzmodels.deit.DeiTOnnxConfigZdetrrIrLzmodels.detr.DetrOnnxConfigZ distilbertz&models.distilbert.DistilBertOnnxConfigZelectraz models.electra.ElectraOnnxConfigZflaubertz"models.flaubert.FlaubertOnnxConfigZgpt2zmodels.gpt2.GPT2OnnxConfigZgptjzmodels.gptj.GPTJOnnxConfigzgpt-neozmodels.gpt_neo.GPTNeoOnnxConfigZgroupvitz"models.groupvit.GroupViTOnnxConfigZibertzmodels.ibert.IBertOnnxConfigZimagegptz"models.imagegpt.ImageGPTOnnxConfigZlayoutlmz"models.layoutlm.LayoutLMOnnxConfigZ layoutlmv3z&models.layoutlmv3.LayoutLMv3OnnxConfigZlevitzmodels.levit.LevitOnnxConfigZlongt5zmodels.longt5.LongT5OnnxConfigZ longformerz&models.longformer.LongformerOnnxConfigZmarianzmodels.marian.MarianOnnxConfigZmbartzmodels.mbart.MBartOnnxConfigZ mobilebertz&models.mobilebert.MobileBertOnnxConfigz mobilenet-v1z)models.mobilenet_v1.MobileNetV1OnnxConfigz mobilenet-v2z)models.mobilenet_v2.MobileNetV2OnnxConfigZ mobilevitz$models.mobilevit.MobileViTOnnxConfigZmt5zmodels.mt5.MT5OnnxConfigzm2m-100zmodels.m2m_100.M2M100OnnxConfigZowlvitzmodels.owlvit.OwlViTOnnxConfigZ perceiverz$models.perceiver.PerceiverOnnxConfigZ poolformerz&models.poolformer.PoolFormerOnnxConfigZrembertz models.rembert.RemBertOnnxConfigZresnetzmodels.resnet.ResNetOnnxConfigZrobertaz models.roberta.RobertaOnnxConfigZroformerz"models.roformer.RoFormerOnnxConfigZ segformerrMz$models.segformer.SegformerOnnxConfigZ squeezebertz(models.squeezebert.SqueezeBertOnnxConfigzmodels.swin.SwinOnnxConfigzmodels.t5.T5OnnxConfigrNz)s1s2r>r>r?*szFeaturesManager.ccs|]}|VqdSrP)keys).0vr>r>r? *szFeaturesManager.N model_type model_namer2cCsX|}|tjvr'|r|d|dn|}t|dttjd|dtj|S)a Tries to retrieve the feature -> OnnxConfig constructor map from the model type. Args: model_type (`str`): The model type to retrieve the supported features for. model_name (`str`, *optional*): The name attribute of the model object, only used for the exception message. Returns: The dictionary mapping each feature to a corresponding OnnxConfig constructor. z ()z is not supported yet. Only z' are supported. If you want to support z) please propose a PR or open up an issue.)lowerrA_SUPPORTED_MODEL_TYPEKeyErrorlistrT)rXrYZmodel_type_and_model_namer>r>r?%get_supported_features_for_model_type,s   z5FeaturesManager.get_supported_features_for_model_typer=cCs |ddS)Nr4r5)r;)r=r>r>r?feature_to_taskFs zFeaturesManager.feature_to_task frameworkcCsL|dvr td|d|dkrtstd|dkr"ts$tddSdS) z Validates if the framework requested for the export is both correct and available, otherwise throws an exception. pttfzAOnly two frameworks are supported for ONNX export: pt or tf, but z was provided.rczOCannot export model to ONNX using PyTorch because no PyTorch package was found.rdzUCannot export model to ONNX using TensorFlow because no TensorFlow package was found.N)r7r RuntimeErrorr )rar>r>r?_validate_framework_choiceJs z*FeaturesManager._validate_framework_choicerccCsXt|}t||dkrtj}ntj}||vr(td|dttj||S)ad Attempts to retrieve an AutoModel class from a feature name. Args: feature (`str`): The feature required. framework (`str`, *optional*, defaults to `"pt"`): The framework to use for the export. Returns: The AutoModel class corresponding to the feature. rczUnknown task: z. Possible values are )rAr`rf_TASKS_TO_AUTOMODELS_TASKS_TO_TF_AUTOMODELSr]r^values)r=rar6Ztask_to_automodelr>r>r?get_model_class_for_featureYs  z+FeaturesManager.get_model_class_for_featuremodelcCs|dur|Sddd}ddd}tj|rItjtj|tr$d}ntjtj|tr2d}n td td td t d ||d nt rOd}n t rUd}nt dt d||d|S)a Determines the framework to use for the export. The priority is in the following order: 1. User input via `framework`. 2. If local checkpoint is provided, use the same framework as the checkpoint. 3. Available framework in environment, with priority given to PyTorch Args: model (`str`): The name of the model to export. framework (`str`, *optional*, defaults to `None`): The framework to use for the export. See above for priority if none provided. Returns: The framework to use for the export. NZPyTorchZ TensorFlowrbZtorchZtf2onnxrcrdzMCannot determine framework from given checkpoint location. There should be a z for PyTorch or z for TensorFlow.zLocal z model found.zKNeither PyTorch nor TensorFlow found in environment. Cannot export to ONNX.zFramework not requested. Using z to export to ONNX.) ospathisdirisfilejoinrrFileNotFoundErrorloggerinforr EnvironmentError)rkraZ framework_mapZ exporter_mapr>r>r?determine_frameworkts0   z#FeaturesManager.determine_framework cache_dirrcCst||}t||}z |j||d}W|StyA|dkr1td|j|d|d}Y|Std|j|d|d}Y|Sw)a Attempts to retrieve a model from a model's name and the feature to be enabled. Args: feature (`str`): The feature required. model (`str`): The name of the model to export. framework (`str`, *optional*, defaults to `None`): The framework to use for the export. See `FeaturesManager.determine_framework` for the priority should none be provided. Returns: The instance of the model. )rvrcz=Loading TensorFlow model in PyTorch before exporting to ONNX.T)Zfrom_tfrvz=Loading PyTorch model in TensorFlow before exporting to ONNX.)Zfrom_ptrv)rArurjZfrom_pretrainedOSErrorrrrs)r=rkrarvZ model_classr>r>r?get_model_from_features     z&FeaturesManager.get_model_from_featurecCsd|jjdd}t|dd}tj||d}||vr't|jjd|d||jjtj||fS)aR Check whether or not the model has the requested features. Args: model: The model to export. feature: The name of the feature to check if it is available. Returns: (str) The type of the model (OnnxConfig) The OnnxConfig instance holding the model export properties. _-namer5)rYz doesn't support feature z. Supported values are: )configrXr;r:rAr_r7r\)rkr=rXrYZmodel_featuresr>r>r?check_supported_model_or_raises z.FeaturesManager.check_supported_model_or_raisecCstj||S)aU Gets the OnnxConfig for a model_type and feature combination. Args: model_type (`str`): The model type to retrieve the config for. feature (`str`): The feature to retrieve the config for. Returns: `OnnxConfig`: config for the combination )rAr\)rXr=r>r>r? get_configs zFeaturesManager.get_configrP)rc)NN)rB)7__name__ __module__ __qualname__rgrhrrrrr!r"r$rrrrrrr r%r#r r&r(r'r,r-r.r)r*r+r@r\sortedrriZAVAILABLE_FEATURES staticmethodstrrrrr rr_r`rfr rjrur rxrr}r~r>r>r>r?rAUs4  #-8AJS]afot} (2<ENVZcfmtw~%*/4;BFLOY^hsy   5 1    rA)9rl functoolsrrtypingrrrrrr r r8r5r r rutilsrrrr|rrrZ get_loggerrrrZtransformers.models.autorrrrrrrrrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.warningrr@rAr>r>r>r?s6$  D,