o Zh@szdZddlZddlmZmZmZddlmZddlm Z ddl m Z m Z m Z mZmZddlmZGd d d e Zd gZdS) z& Image/Text processor class for FLAVA N)ListOptionalUnion) ImageInput)ProcessorMixin) BatchEncodingPaddingStrategyPreTokenizedInput TextInputTruncationStrategy) TensorTypec(s2eZdZdZddgZdZdZd*fdd Z         d+d ee d ee e e e e e e fdede eeefde eeefdeededeedeedeedeedeededededededee eeff$ddZd d!Zd"d#Zed$d%Zed&d'Zed(d)ZZS),FlavaProcessora Constructs a FLAVA processor which wraps a FLAVA image processor and a FLAVA tokenizer into a single processor. [`FlavaProcessor`] offers all the functionalities of [`FlavaImageProcessor`] and [`BertTokenizerFast`]. See the [`~FlavaProcessor.__call__`] and [`~FlavaProcessor.decode`] for more information. Args: image_processor ([`FlavaImageProcessor`], *optional*): The image processor is a required input. tokenizer ([`BertTokenizerFast`], *optional*): The tokenizer is a required input. image_processor tokenizerZFlavaImageProcessor)Z BertTokenizerZBertTokenizerFastNc sld}d|vrtdt|d}|dur|n|}|dur!td|dur)tdt|||j|_dS)Nfeature_extractorzhThe `feature_extractor` argument is deprecated and will be removed in v5, use `image_processor` instead.z)You need to specify an `image_processor`.z"You need to specify a `tokenizer`.) warningswarn FutureWarningpop ValueErrorsuper__init__rZcurrent_processor)selfrrkwargsr __class__Y/var/www/auris/lib/python3.10/site-packages/transformers/models/flava/processing_flava.pyr,s  zFlavaProcessor.__init__TFrimagestextadd_special_tokenspadding truncation max_lengthstridepad_to_multiple_ofreturn_image_maskreturn_codebook_pixelsreturn_token_type_idsreturn_attention_maskreturn_overflowing_tokensreturn_special_tokens_maskreturn_offsets_mapping return_lengthverbosereturn_tensorscKs|dur |dur td|dur(|jd|||||||| | | |||||d|}|dur9|j|f| | |d|}|durH|durH|||S|durN|Sttdi||dS)a  This method uses [`FlavaImageProcessor.__call__`] method to prepare image(s) for the model, and [`BertTokenizerFast.__call__`] to prepare text for the model. Please refer to the docstring of the above two methods for more information. Nz?You have to specify either text or images. Both cannot be none.)r r!r"r#r$r%r&r)r*r+r,r-r.r/r0)r'r(r0)dataZ tensor_typer)rrrupdaterdict)rrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0rencodingZimage_featuresrrr__call__?sL zFlavaProcessor.__call__cO|jj|i|S)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.batch_decode`]. Please refer to the docstring of this method for more information. )r batch_decoderargsrrrrr7zFlavaProcessor.batch_decodecOr6)z This method forwards all its arguments to BertTokenizerFast's [`~PreTrainedTokenizer.decode`]. Please refer to the docstring of this method for more information. )rdecoder8rrrr;r:zFlavaProcessor.decodecCs"|jj}|jj}tt||S)N)rmodel_input_namesrlistr3fromkeys)rZtokenizer_input_namesZimage_processor_input_namesrrrr<sz FlavaProcessor.model_input_namescCtdt|jS)Nzg`feature_extractor_class` is deprecated and will be removed in v5. Use `image_processor_class` instead.)rrrimage_processor_classrrrrfeature_extractor_class z&FlavaProcessor.feature_extractor_classcCr?)Nz[`feature_extractor` is deprecated and will be removed in v5. Use `image_processor` instead.)rrrrrArrrrrCz FlavaProcessor.feature_extractor)NN)NNTFFNrNNNNNFFFFTN)__name__ __module__ __qualname____doc__ attributesr@Ztokenizer_classrrrrr r rboolstrr r intr r5r7r;propertyr<rBr __classcell__rrrrrs         D  r)rGrtypingrrrZ image_utilsrZprocessing_utilsrZtokenization_utils_baserr r r r utilsr r__all__rrrrs