o Zh@sdZddlmZddlmZddlmZmZm Z ddl m Z e e Zd Zd ejd ed ed ejfddZGddde ZGdddeZGdddeZgdZdS)zFlax mT5 model.N)logging)FlaxT5EncoderModelFlaxT5ForConditionalGeneration FlaxT5Model) MT5ConfigZT5Config input_ids pad_token_iddecoder_start_token_idreturncCsdt|}|jddddf|ddddf}|jdddf|}t|dk||}|S)z1 Shift input ids one token to the right. Nrri)jnpZ zeros_likeatsetwhere)r r r Zshifted_input_idsrX/var/www/auris/lib/python3.10/site-packages/transformers/models/mt5/modeling_flax_mt5.pyshift_tokens_rights ,rc@eZdZdZdZeZdS) FlaxMT5Modela This class overrides [`FlaxT5Model`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxMT5Model, AutoTokenizer >>> model = FlaxMT5Model.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(input_ids=inputs["input_ids"], decoder_input_ids=decoder_input_ids) >>> hidden_states = outputs.last_hidden_state ```mt5N__name__ __module__ __qualname____doc__Z model_typer Z config_classrrrrr*rc@r)FlaxMT5EncoderModela  This class overrides [`FlaxT5EncoderModel`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxT5EncoderModel, AutoTokenizer >>> model = FlaxT5EncoderModel.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(input_ids=inputs["input_ids"]) >>> hidden_states = outputs.last_hidden_state ```rNrrrrrrErrc@r)FlaxMT5ForConditionalGenerationa- This class overrides [`FlaxT5ForConditionalGeneration`]. Please check the superclass for the appropriate documentation alongside usage examples. Examples: ```python >>> from transformers import FlaxMT5ForConditionalGeneration, AutoTokenizer >>> model = FlaxMT5ForConditionalGeneration.from_pretrained("google/mt5-small") >>> tokenizer = AutoTokenizer.from_pretrained("google/mt5-small") >>> article = "UN Offizier sagt, dass weiter verhandelt werden muss in Syrien." >>> summary = "Weiter Verhandlung in Syrien." >>> inputs = tokenizer(article, return_tensors="np") >>> decoder_input_ids = tokenizer(text_target=summary, return_tensors="np").input_ids >>> outputs = model(**inputs, decoder_input_ids=decoder_input_ids) >>> logits = outputs.logits ```rNrrrrrr `rr )rr r)rZ jax.numpynumpyrutilsrZt5.modeling_flax_t5rrrZconfiguration_mt5r Z get_loggerrloggerZ_CONFIG_FOR_DOCZndarrayintrrrr __all__rrrrs