o Zh@sndZddlZddlmZmZmZddlmZddlm Z m Z m Z m Z m Z ddlmZGdd d eZd gZdS) z Processor class for ViLT. N)ListOptionalUnion)ProcessorMixin) BatchEncodingPaddingStrategyPreTokenizedInput TextInputTruncationStrategy) TensorTypec"seZdZdZddgZdZdZd(fdd Z       d)d ee e e e e e fd e dee e efdee e efdeededeedee dee de de de de de deee efdef ddZddZd d!Zed"d#Zed$d%Zed&d'ZZS)* ViltProcessorau Constructs a ViLT processor which wraps a BERT tokenizer and ViLT image processor into a single processor. [`ViltProcessor`] offers all the functionalities of [`ViltImageProcessor`] and [`BertTokenizerFast`]. See the docstring of [`~ViltProcessor.__call__`] and [`~ViltProcessor.decode`] for more information. Args: image_processor (`ViltImageProcessor`, *optional*): An instance of [`ViltImageProcessor`]. The image processor is a required input. tokenizer (`BertTokenizerFast`, *optional*): An instance of ['BertTokenizerFast`]. The tokenizer is a required input. image_processor tokenizerZViltImageProcessor)Z BertTokenizerZBertTokenizerFastNc sld}d|vrtdt|d}|dur|n|}|dur!td|dur)tdt|||j|_dS)Nfeature_extractorzhThe `feature_extractor` argument is deprecated and will be removed in v5, use `image_processor` instead.z)You need to specify an `image_processor`.z"You need to specify a `tokenizer`.) warningswarn FutureWarningpop ValueErrorsuper__init__rZcurrent_processor)selfrrkwargsr __class__W/var/www/auris/lib/python3.10/site-packages/transformers/models/vilt/processing_vilt.pyr-s  zViltProcessor.__init__TFrtextadd_special_tokenspadding truncation max_lengthstridepad_to_multiple_ofreturn_token_type_idsreturn_attention_maskreturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverbosereturn_tensorsreturncKsL|jd|||||||| | | | | |||d|}|j||d}|||S)a  This method uses [`ViltImageProcessor.__call__`] method to prepare image(s) for the model, and [`BertTokenizerFast.__call__`] to prepare text for the model. Please refer to the docstring of the above two methods for more information. )rrr r!r"r#r$r%r&r'r(r)r*r+r,)r,Nr)rrupdate)rZimagesrrr r!r"r#r$r%r&r'r(r)r*r+r,rencodingZencoding_image_processorrrr__call__@s, zViltProcessor.__call__cO|jj|i|S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r batch_decoderargsrrrrr2rzViltProcessor.batch_decodecOr1)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )rdecoder3rrrr6yr5zViltProcessor.decodecCs"|jj}|jj}tt||S)N)rmodel_input_namesrlistdictfromkeys)rZtokenizer_input_namesZimage_processor_input_namesrrrr7szViltProcessor.model_input_namescCtdt|jS)Nzg`feature_extractor_class` is deprecated and will be removed in v5. Use `image_processor_class` instead.)rrrimage_processor_classrrrrfeature_extractor_class z%ViltProcessor.feature_extractor_classcCr;)Nz[`feature_extractor` is deprecated and will be removed in v5. Use `image_processor` instead.)rrrrr=rrrrr?zViltProcessor.feature_extractor)NN)NTFNNrNNNFFFFTN)__name__ __module__ __qualname____doc__ attributesr<Ztokenizer_classrrr r rboolstrrr rintr rr0r2r6propertyr7r>r __classcell__rrrrr s|         2  r )rCrtypingrrrZprocessing_utilsrZtokenization_utils_baserrr r r utilsr r __all__rrrrs   |