o Zh'C@sddlmZmZmZddlZddlmZmZm Z m Z ddl m Z m Z ddlmZddlmZmZmZddlmZmZmZmZGd d d ed d ZGd dded d ZGddde ZdgZdS))ListOptionalUnionN) ImagesKwargsProcessingKwargsProcessorMixinUnpack)PreTokenizedInput TextInput) BatchFeature) ImageInputconcatenate_listmake_flat_list_of_images) VideoInput VideoMetadata load_videomake_batched_videosc@s2eZdZUeeed<eeed<eeed<dS)InternVLImagesKwargscrop_to_patchesZ min_patchesZ max_patchesN)__name__ __module__ __qualname__rbool__annotations__intrr_/var/www/auris/lib/python3.10/site-packages/transformers/models/internvl/processing_internvl.pyr&s  rF)totalc@s*eZdZUeed<ddiddiidZdS)InternVLProcessorKwargs images_kwargsZ padding_sideleftrT) text_kwargsr videos_kwargsN)rrrrr _defaultsrrrrr,s  rc sDeZdZdZgdZddgZdZdZdZ    d,de ffd d Z d e e d e e de e de jde jde jf ddZ    d-deed eeeeeeeefdeedeedef ddZ d.dedee deeee ffddZd d!Zd"d#Z e!d$d%Z" & d/d'ee d(fdee d)e dede j#f d*d+Z$Z%S)0InternVLProcessoraM Constructs a InternVL processor which wraps a [`AutoImageProcessor`] and [`PretrainedTokenizerFast`] tokenizer into a single processor that inherits both the image processor and tokenizer functionalities. See the [`~InternVLProcessor.__call__`] and [`~InternVLProcessor.decode`] for more information. Args: image_processor ([`AutoImageProcessor`], *optional*): The image processor is a required input. tokenizer ([`PreTrainedTokenizer`, `PreTrainedTokenizerFast`], *optional*): The tokenizer is a required input. video_processor ([`AutoVideoProcessor`], *optional*): The video processor is a required input. image_seq_length (`int`, *optional*, defaults to 256): The number of image token to use per image patch. it should be set so that: image_seq_length = (config.image_size // config.patch_size) ** 2 * (config.scale_factor**2) chat_template (`str`, *optional*): A Jinja template which will be used to convert lists of messages in a chat into a tokenizable string. )image_processor tokenizervideo_processor chat_templateimage_seq_lengthZAutoImageProcessorZAutoVideoProcessorZ AutoTokenizerNc sN||_|j|_|j|_|j|_|j|_|j|_tj |||fd|i|dS)Nr)) r*start_image_tokenend_image_tokenZcontext_image_token image_token video_tokenZcontext_image_token_idZimage_token_idsuper__init__)selfr&r'r(r*r)kwargs __class__rrr1Us  zInternVLProcessor.__init__textimage_num_patchesvideo_num_patchesimage_num_patches_indicesvideo_num_patches_indicesvideo_patch_indicesc sd} d} g} g} g} |D]}|}j|vsj|vrȈj|vrkj|vs0|j|jkrk| dkr:|| dnd}|| }| ||||jdd}| jjj|| j| d7} nS| dkru|| dnd}|| }| dkr||nd}||d}| |||t|||d fddt t D}| ||jdd}| d7} j|vsj|vsd|vr| d}|d|d}d|vs| |q | | | | fS)z Processes interleaved text with and