eThwrSrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK r SSKJr SSKJr SSKJrJrJr SSKJr SSKJr SS KJrJrJrJrJrJ r SS K!J"r"J#r# \ RH"\%5r&\ RN"5r(S r)S \\*\RV4S S4Sjr,S\\*\RV4S \-\*4Sjr.S\\*\RV4S \-\*4Sjr/S\\*\RV4S \-\*4Sjr0S\\*\RV4S \-\*4Sjr1SS.S\*S\\*\RV4S\2S \34Sjjr4S1S\\*\RV4S\*S\\\*\RV4S\2S\\2S\\5\*\*4S \\\2\*4S!\\*S"\2S#\\*S$\\*S \*4S%jjr6S1S&\*S\\*\RV4S\\\*\RV4S\2S\\2S\\5\*\*4S \\\2\*4S!\\*S"\2S#\\*S'\\*S \34S(jjr7S2S)\S*\\*\RV4S+\\5S \-\*4S,jjr8S-r9S.r:S2S/jr;S3S0jr-=Cs)-=>()Q. ##N3i GY>s B=* C7CCfilenamec^^^[USS9nUR5nSSS5 [5mSSKmUUU4Sjm[R "W5nT"U5 [ T5$!,(df  NM=f)z Extracts all the libraries (not relative imports this time) that are imported in a file. Args: filename (`str` or `os.PathLike`): The module file to inspect. Returns: `list[str]`: The list of all packages required to use the input module. r-r.Nrc>[U[R5(ag[U[R5(aURn[R "U5Hn[U[R 5(dM$[URSS5nURS5(aURS5(d'[T RRU5(dM g O[U[R5(aLURH;nUR R#S5SnU(dM*TR%U5 M= Ov[U[R&5(aWUR(S:XaGUR*(a6UR*R#S5SnU(aTR%U5 [R,"U5H nT"U5 M g)Nid available is_flash_attn.r) isinstanceastTryIftestwalkCallgetattrfuncendswith startswithhasattrutils import_utilsImportnamesr$splitadd ImportFromlevelmoduleiter_child_nodes) noderUcondition_nodecheck_functionalias top_modulechildimported_modulesrecursive_look_for_imports transformerss r!rn/get_imports..recursive_look_for_importssb dCGG $ $  cff % %99D"%((4.nchh77%,^-@-@$%KN&// <<*55oFF"<#5#5#B#BNSS#1cjj ) )"ZZ--c215 :$((4$cnn - -zzQ4;;![[..s3A6 $((4))$/E &u -0r#)r1r2r7transformers.utilsrRparsesorted)rIr8r9treermrnros @@@r! get_importsrus` h )Q&&( *u.B 99W Dt$ " ##U * )s A&& A4c[U5n/nUHn[R"U5 M [U5S:a0[SSRU5SS RU5S 35e[U5$![aGn[R SUSU35 S[ U5;aURU5 SnAMeSnAff=f) a Check if the current Python environment contains all the libraries that are imported in a file. Will raise if a library is missing. Args: filename (`str` or `os.PathLike`): The module file to check. Returns: `list[str]`: The list of relative imports in the file. z&Encountered exception while importing z: zNo module namedNrz\This modeling file requires the following packages that were not found in your environment: z, z. Run `pip install  `) rur import_module ImportErrorloggerwarningr?rr@joinr;)rIimportsmissing_packagesimp exceptions r! check_importsrs(#G   # #C ( q  jyy)*++>sxxHX?Y>ZZ[ ]   ))!  NNCC59+V W!C N2 '',, sA88 C ;CCC F force_reload class_namerErc [RRU5nURS5(aUSSnUR [RR S5n[ [5U- n[ U(a5[RRUS5 [R"5 [RRU5n[RR!X4S9nU/[#[%[ ['U555-n[(R*"SR-SU555R/5nUc3[RR1U5n U [RU'OUn [3U SS 5U:wa!UR4R7U 5 Xl[3X5sSSS5 $!,(df  g=f) a Import a module on the cache directory for modules and extract a class from it. Args: class_name (`str`): The name of the class to import. module_path (`str` or `os.PathLike`): The path to the module to import. force_reload (`bool`, *optional*, defaults to `False`): Whether to reload the dynamic module from file if it already exists in `sys.modules`. Otherwise, the module is only reloaded if the file has changed. Returns: `typing.Type`: The class looked for. r=NrP)locationr#c3Z# UH!n[U5UR5-v M# g7fN)bytes read_bytes).0r8s r! &get_class_in_module.. s"2cVbQR58alln3LVbs)+__transformers_module_hash__rM)rrnormpathrZreplaceseprr _HF_REMOTE_CODE_LOCKrmodulespoprrgetutilspec_from_file_locationrsmaprHhashlibsha256r} hexdigestmodule_from_specrXloader exec_moduler) rrErr$r+ cached_module module_spec module_files module_hashres r!get_class_in_modulers^& 77  K (D }}UCRy << S )D-.>#((2cVb2c*cdnnp   ^^44[AF &CKK "F 692 >+ M    * *6 22= /v*-   s =E G G"pretrained_model_name_or_path cache_dirforce_downloadresume_downloadproxiestokenrevisionlocal_files_only repo_type _commit_hashc  U RSS5n U b+[R"S[5 Ub [ S5eU n[ 5(aU(d[ RS5 Sn[U5n[RRU5n U (a [RRU5nO5URS[RR5n[XX*U S9n/n[!UUUUUUUUUU U S 9 nU (dWU:waUR#U5 ['U5n[([RR-U-n[+U5 [-[.5U- nU[RRU5:XGaUU- R15(a([2R4"U[UU- 55(d/[6R8"UUU- 5 [:R<"5 UHnUS 3n[RR?UU5nUU- R15(a*[2R4"U[UU- 55(aMj[6R8"UUU- 5 [:R<"5 M GO[AUU 5nUU- nU[RR-U-n[RR?UU5n[+[-U5RB5 UU- R15(d/[6R8"UUU- 5 [:R<"5 UHInUUS 3- R15(aM [EUUS 3UUUUUUUUS9 UR#US 35 MK [GU5S:aUUcRSR?UVs/sHnSU3PM sn5nU cSOU S3nSUU3n[ RISUSUS35 [RR?UU5$![$a [ RS US US 35 ef=fs snf)a. Prepares Downloads a module from a local folder or a distant repo and returns its path inside the cached Transformers module. Args: pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. module_file (`str`): The name of the module file containing the class to look for. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `huggingface-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). Passing `token=True` is required when you want to use a private model. Returns: `str`: The path to the module inside the cache. use_auth_tokenNrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.V`token` and `use_auth_token` are both specified. Please set only the argument `token`.z+Offline mode: forcing local_files_only=TrueT/)rrr) rrrrrrrrrzCould not locate the z inside rPr=)rrrrrrrrr z- rMzs/zhttps://huggingface.co/z9A new version of the following files was downloaded from z: z . Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.)%rwarningswarn FutureWarning ValueErrorrr{infor?rrisdirbasenamerrrr rOSErrorrr r)rr rfilecmpcmpshutilcopyrrr}rr(get_cached_module_filer@r|)rr+rrrrrrrrrdeprecated_kwargsris_local submoduler new_filesresolved_module_filemodules_neededfull_submodulesubmodule_path module_neededmodule_needed_file commit_hashfull_submodule_module_file_pathr8 repo_type_strurls r!rrs|'**+;TBN!  A    uv v!1 AB%((E$F!ww}}:;HGG$$%BC 199#rww{{K . ))nw I* ) )+-% M-AA   [ )##78N6 CiON.)*+n M (+5'"''++5 C*,'',,~{*S'd#BCJJK,4466 KK,n{.J K  ' ' )+M" c%::BBDD&1$oS)'#1$3#%%5!,   M?#!67,  9~h.II;AA3x;< '/ {"5E ' 7T6UVGuCPY{ A A 77<< 44I  +K=A^@__`ab v Calling this function will execute the code in the module file found locally or downloaded from the Hub. It should therefore only be called on trusted repos. Args: class_reference (`str`): The full name of the class to load, including its module and optionally its repo. pretrained_model_name_or_path (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a pretrained model configuration hosted inside a model repo on huggingface.co. - a path to a *directory* containing a configuration file saved using the [`~PreTrainedTokenizer.save_pretrained`] method, e.g., `./my_model_directory/`. This is used when `class_reference` does not specify another repo. module_file (`str`): The name of the module file containing the class to look for. class_name (`str`): The name of the class to import in the module. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or `bool`, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `huggingface-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). code_revision (`str`, *optional*, defaults to `"main"`): The specific revision to use for the code on the Hub, if the code leaves in a different repository than the rest of the model. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. Passing `token=True` is required when you want to use a private model. Returns: `typing.Type`: The class, dynamically imported from the module. Examples: ```python # Download module `modeling.py` from huggingface.co and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("modeling.MyBertModel", "sgugger/my-bert-model") # Download module `modeling.py` from a given repo and cache then extract the class `MyBertModel` from this # module. cls = get_class_from_dynamic_module("sgugger/my-bert-model--modeling.MyBertModel", "sgugger/another-bert-model") ```rNrrz--rPr=)rrrrrrrrr)rrrrrrarr)rrrrrrrrrrrkwargsrrepo_idr+r final_modules r!get_class_from_dynamic_modulerstZZ 0$7N!  A    uv v #2#8#8#> /-33C8K!>!I )e%') L zT RRnURS5SnUST RR3nSU;aSnSnT RRR S5(agUST RR3n[ T SS5b=[ T S5nURnURS5SnUSUR3nOUST RR3nXE4n[ U[5(a%URS05n X9T R'XS'g[ USS5bX0RT R'gT RU0Ul g)NrP TokenizerFastslow_tokenizer_classauto_map) __class__ __module__ra__name__rZrXrQdictr _auto_classr) _config module_name last_module full_namerfast_tokenizer_classslow_tokenizerslow_tok_module_namelast_slow_tok_modulerrs r!_set_auto_map_in_config3custom_object_save.._set_auto_map_in_config^somm.. !'',R0 "m1S]]%;%;$<= ) ##' #' }}%%..v66*5a 8N8N7O'P$3 6=I%,S2H%IN+9+D+D(+?+E+Ec+J2+N(.B-C1^E\E\D]+^(+6a 8N8N7O'P$-DI gt $ ${{:r2H(1S__ %"*J  Wj$ / ;09  S__ - #;G r#)rr{r|rQr6tuplerr__file__rr$rrrrH) rrrrcfgresult object_file dest_file needed_files ` r!custom_object_saverHs  ~~#.se4x@  <@&4-((C #C (  ' F++cnn-66KV [ 1 6 67I KK ' MM)1= LD$5$:$:;  K+ i > Mr#c[S5e)NzLoading this model requires you to execute custom code contained in the model repository on your local machine. Please set the option `trust_remote_code=True` to permit loading of this model.)r)signumframes r!_raise_timeout_errorrs  c r#c`U=(d SUS3nUGcU(aSnGOU(a[S:aSn[R"[R[5n[R"[5 UcC[ USUS35nUR 5S;aS nOUR 5S ;aSnUcMC[R"S5 Ub;[R"[RU5 [R"S5 OU(a [SS5 U(aU(dU(d[USUS 35eU$![a [USUS 35ef=f!Ub<[R"[RU5 [R"S5 ff=f) a Resolves the `trust_remote_code` argument. If there is remote code to be loaded, the user must opt-in to loading it. Args: trust_remote_code (`bool` or `None`): User-defined `trust_remote_code` value. model_name (`str`): The name of the model repository in huggingface.co. has_local_code (`bool`): Whether the model has local code. has_remote_code (`bool`): Whether the model has remote code. error_message (`str`, *optional*): Custom error message to display if there is remote code to load and the user didn't opt-in. If unset, the error message will be regarding loading a model with custom code. Returns: The resolved `trust_remote_code` value. zThe repository `zJ` contains custom code which must be executed to correctly load the model.NFrz9 You can inspect the repository content at https://hf.co/z. You can avoid this prompt in future by passing the argument `trust_remote_code=True`. Do you wish to run the custom code? [y/N] )yesy1T)non0rMzS. Please pass the argument `trust_remote_code=True` to allow custom code to be run.) TIME_OUT_REMOTE_CODEsignalSIGALRMralarminputlower Exceptionr)trust_remote_code model_namehas_local_codehas_remote_code error_messageprev_sig_handleranswers r!resolve_trust_remote_coders.  u j\)s t   %  !5!9#  $#)==AU#V  12'/"(/)bcmbnoEFF ||~)::,0)+??,1)(/ Q$/MM&..2BCLLO  t ,~6GoVWaVbc` a  )  $o%^_i^jkhi $/MM&..2BCLLO0sBE <E E))E,,AF-c L/n[S XS.UD6n[US5nUR5nSSS5 UHnUR5nU(aUR S5(aM2[ U5upxn [RRU5n UbIU bF[R"U5"[R"U 5[R"U 55n OSn U (aMURUSU S 35 M U(a![!S US 3S R#U5-5eg!,(df  GN =f![ a UnSupNf=f![RRa URUS35 GMZf=f![a Nf=f)a Tries to locate `requirements_file` in a local folder or repo, and confirms that the environment has all the python dependencies installed. Args: path_or_repo_id (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a model repo on huggingface.co. - a path to a *directory* potentially containing the file. kwargs (`Dict[str, Any]`, *optional*): Additional arguments to pass to `cached_file`. )path_or_repo_idrIrN#)NNz (installed: None)Tz (installed: )z4Missing requirements in your local environment for `z`: r)r r1 readlinesstripr[rrrmetadatar PackageNotFoundErrorrr from_stringrrrrzr}) rrequirements_filerfailed requirementsr8 requirement package_name delimiterversion_numberlocal_package_version is_satisfieds r!check_python_requirementsr)sF" "i?ibhi , $;;=L%(K%++-K+"8"8"="= 7:OP[:\7   (1(:(:(B(B<(P% $)C0<B?BSSW X[_[d[dek[l l  E% $ 7* ,6) > 7 %%::   -?@A     spFD4FEFEF2FFFF F#"F#) NFNNNNFNNr)zrequirements.txt)=__doc__rRrrrimportlib.metadataimportlib.utilrr3rrr threadingrpathlibrtypesrtypingrrrhuggingface_hubr packagingr r]r r r rrrutils.import_utilsrr get_loggerrr{Lockrr"r?PathLiker)r6r;rHrurbooltyperrrrrrrrr)rr#r!r9s:  ''2I   H % ~~' & &c2;;&6 7&D&,'eC,<&='$s)'* 5bkk1A+B tCy B4$%R[[ 014$d3i4$n *E#r{{"23 *S *N .+.+sBKK'(.+ .+  .+h48 &*(,(,""#"&n5#(bkk)9#:n5n5c2;;./0n5 n5 d^ n5 d38n % n5 E$)$ %n5smn5n5}n53-n5 n5h48 &*(,(,""##'zVzV#(bkk)9#:zVc2;;./0zV zV d^ zV d38n % zV E$)$ %zVsmzVzV}zVC=zV zVzICIsBKK/?)@I(SW.IdhildmIXBJ5 r#