fTh^$vSrSSKrSSKrSSKrSSKrSSKrSSKrSSKJr SSK J r SSK J r J r SSKJr SSKJr SSKrSSKrSSKJrJrJrJrJrJrJrJrJrJrJrJrJ r SS K!J"r"J#r# SS K$J%r%J&r&J'r'J(r(J)r)J*r*J+r+J,r,J-r-J.r.J/r/ SS K0J1r1 S S K2J3r3J4r4 S SK5J6r6 S SK7J8r8J9r9J:r:J;r;JSr?Sr@\4R"\B5rC\R0RrESrF\R"S\RR\R"SS5S55rJ\RrK\R"S\R5rM\R"S\M5rN\R"S\N5rO\R"S\RR\RS55rQSrR\"5RrTSH/rU\R"\U5cM\R"S\US 3\W5 M1 S!rXS"rY\RRS#S$5R5\8;r]\](aS%OS&r^\^r_\RRS'S5b/\R"S(\W5 \RRS'S5r_\RRS)\_5r_\_S*-r`\_S+-raS]S,\bS-\bS.\ \b\ S4S/\ \b4S0jjrcSSS1.S2\bS3\dS/\ \bS.\ \bS4\e\b4 S5jjrfS6rgS7rhS^S8\ \i\bS4S4\b4S9jjrjS:\ \bS;\ \bS4\ \b4S<jrkS,\ \b\R4S=\bS4\ \b4S>jrmS_S,\ \b\R4S@\e\bS.\ \ \b\R4SA\dSB\ \dSC\ \i\b\b4SD\ \ \d\b4S/\ \bS3\dSE\bSF\ \bS8\ \ \b\i\b\b44SG\dSH\dSI\dSJ\ \bS4\ \b4"SKjjrnS^SLjroS`S?SSSM.SN\ \b\R4S=\bS/\ \bSC\ \i\b\b4SD\ \ \d\b4S3\dS.\ \b\ S4SF\ \b4SOjjjrp"SPSQ5rqSRSS.STjrrSU\ \s\b44SVjrtSaSWjruSbS2\bSX\ \e\bSD\ \bSY\d4SZjjrv"S[S\5rwg)cz? Hub utilities: utilities related to download and cache models N)futures)Path)OptionalUnion)urlparse)uuid4) _CACHED_NO_EXISTCommitOperationAdd ModelCard ModelCardData constants create_branch create_commit create_repohf_hub_download hf_hub_urllist_repo_treesnapshot_downloadtry_to_load_from_cache)REGEX_COMMIT_HASHhttp_get) EntryNotFoundErrorGatedRepoErrorHfHubHTTPErrorLocalEntryNotFoundErrorOfflineModeIsEnabledRepositoryNotFoundErrorRevisionNotFoundErrorbuild_hf_headers get_sessionhf_raise_for_statussend_telemetry) HTTPError) __version__logging)working_or_temp_dir)ENV_VARS_TRUE_VALUES _tf_version_torch_versionis_tf_availableis_torch_availableis_training_run_on_sagemakerzchat_template.jsonzchat_template.jinjaadditional_chat_templatesc[$N)_is_offline_modeN/var/www/auris/envauris/lib/python3.13/site-packages/transformers/utils/hub.pyis_offline_moder5Us r3 TORCH_HOMEXDG_CACHE_HOMEz~/.cachetorchPYTORCH_PRETRAINED_BERT_CACHEPYTORCH_TRANSFORMERS_CACHETRANSFORMERS_CACHEHF_MODULES_CACHEmodulestransformers_modules)r9r:r;zUsing `zQ` is deprecated and will be removed in v5 of Transformers. Use `HF_HOME` instead.z3https://s3.amazonaws.com/models.huggingface.co/bertzhttps://cdn.huggingface.coHUGGINGFACE_CO_STAGINGNOzhttps://hub-ci.huggingface.cozhttps://huggingface.coHUGGINGFACE_CO_RESOLVE_ENDPOINTzUsing the environment variable `HUGGINGFACE_CO_RESOLVE_ENDPOINT` is deprecated and will be removed in Transformers v5. Use `HF_ENDPOINT` instead. HF_ENDPOINTz)/{model_id}/resolve/{revision}/{filename}z/api/telemetry/examplespath_or_repo_id full_filename cache_dirrevisionc6[XX#S9nUb U[:waU$g)N)rErF)rr )rCrDrErF resolved_files r4_get_cache_file_to_returnrIs(+?U^rM ]6F%F r3)rFrErepo_idlocal_files_onlyreturncU(dc[X[SS9Vs/sHGnURRS5(dM%URR [S35PMI sn$[XUSS9n[U[5nUR5(d/$UR5Vs/sHGoDR5(dMUR RS5(dM;UR"PMI sn$s snf![ [ [4a e[[4a Nf=f![a /s$f=fs snf)zList template files from a repo. A template is a jinja file located under the `additional_chat_templates/` folder. If working in offline mode or if internet is down, the method will list jinja template from the local cache - if any. F)rJrF path_in_repo recursivez.jinja/T)rJrFrErK)rCHAT_TEMPLATE_DIRpathendswith removeprefixrrrConnectionErrorr#rrris_diriterdiris_filenamestem)rJrKrFrEentry snapshot_dir templates_dirs r4list_repo_templatesr^s8  ,#EVbgE::&&x0 A ''+<*=Q(?@ ()VZ '89M    ! ! $1$9$9$; q$;5}}JSXS]S]SfSfgoSpJEJJ$; qq- 79NO  +    #  rsLD$D&D(D, D10E E.ED%D.-D.1 E?Ec6[U5nURS;$)N)httphttps)rscheme)url_or_filenameparseds r4 is_remote_urlres o &F ==- --r3c v[R"[RS5R 5nUSnUSR S5Sn[R"[R"SS55nSU;aSOS nS [R;a([R"S 5R S5S OSn[R"S S5[R"S S5[R"SS5[R"SS5UUUUS.nU$![ a SnSnNf=f)NECS_CONTAINER_METADATA_URIImage:r$SM_FRAMEWORK_PARAMSz{}*sagemaker_distributed_dataparallel_enabledTFTRAINING_JOB_ARNSM_FRAMEWORK_MODULE AWS_REGION SM_NUM_GPUSr SM_NUM_CPUS) sm_framework sm_region sm_number_gpu sm_number_cpusm_distributed_trainingsm_deep_learning_containersm_deep_learning_container_tag sm_account_id) requestsgetosenvironjsonsplit Exceptionloadsgetenv) instance_datadlc_container_useddlc_tagsagemaker_paramsruns_distributed_training account_idsagemaker_objects r4define_sagemaker_informationrs RZZ0L%MNSSU *73(..s3A6 zz")),A4"HI(TXh(hns@RVXV`V`@`-.44S9!YY|T2=!4=!4#<&8*1#  % !sAD''D87D8 user_agentcS[S[RR5SS[3n[ 5(a US[ 3- n[5(a US[3- n[R(aUS-$[5(a4USSRS [5R555-- n[R R#S S 5R%5[&;aUS - n[)U[*5(a.USSRS UR555-- nU$[)U[,5(aUSU-- nU$)z> Formats a user-agent string with basic info about a request. z transformers/z ; python/rz ; session_id/z; torch/z ; tensorflow/z; telemetry/offz; c34# UHupUSU3v M g7frPNr2.0kvs r4 "http_user_agent..s]6\da!AaSz6\TRANSFORMERS_IS_CIz ; is_ci/truec34# UHupUSU3v M g7frr2rs r4rrsI6Hda!AaSz6Hr)r%sysversionr SESSION_IDr,r*r+r)r HF_HUB_DISABLE_TELEMETRYr-joinritemsr|r}r{upperr( isinstancedictstr)ruas r4http_user_agentrs9  Ys{{/@/@/B1/E.FmT^S_ `B ()) k]++))%%%#%% dTYY]6R6T6Z6Z6\]]]] zz~~*B/557;OO n*d## dTYYIj6F6F6HIIII I J $ $ dZ Ir3rH commit_hashcUbUbU$[[U5R55n[R"SU5nUcgUR 5Sn[ R"U5(aU$S$)zH Extracts the commit hash from a resolved filename toward a cache file. Nzsnapshots/([^/]+)/r)rras_posixresearchgroupsrmatch)rHrrs r4extract_commit_hashrsq 7]+4467M YY,m >;HDHr3filenamec :[SX/S.UD6nUbUSnU$UnU$)a Tries to locate a file in a local folder and repo, downloads and cache it if necessary. Args: path_or_repo_id (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a model repo on huggingface.co. - a path to a *directory* potentially containing the file. filename (`str`): The name of the file to locate in `path_or_repo`. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `huggingface-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. subfolder (`str`, *optional*, defaults to `""`): In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can specify the folder name here. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). Passing `token=True` is required when you want to use a private model. Returns: `Optional[str]`: Returns the resolved file (to the cache folder if downloaded from a repo). Examples: ```python # Download a model weight from the Hub and cache it. model_weights_file = cached_file("google-bert/bert-base-uncased", "pytorch_model.bin") ``` )rC filenamesrr2) cached_files)rCrkwargsfiles r4 cached_filers9t  X: XQW XD&47D K-1D Kr3Frforce_downloadresume_downloadproxiestoken subfolder repo_type _raise_exceptions_for_gated_repo%_raise_exceptions_for_missing_entries'_raise_exceptions_for_connection_errors _commit_hashc  URSS5nUb+[R"S[5 Ub [ S5eUn[ 5(aU(d[ RS5 SnU cSn UVs/sH#n[RRU U5PM% nn[U5n/nUHn[RRU5(dM)[RRUU5n[RRU5(dKU (aBU[RRU S5:waUcS OUn[US US US US 35e gURU5 M [!U5[!U5:XaU$Uc["n[%U[&5(a [U5n/nSnUb`U(dYUHSn[)UUX/U S9nUcMU[*LaUS- nURU5 M5U (dUS- nMC[SUSUS35e U[!U5:Xa[!U5S:aU$S$[-U 5n [!U5S:Xa)[/UUS[!U 5S:XaSOU U UUU UUUUUS9 O[1UUU UUU UUUUUS9 UVs/sHn[?UUX'5PM nn[KS#U55(aU (a[MUU5VVs/sH unnUbM UPM nnn[!U5S:Xa(US[RRU S5:XagUcS OUn[!U5S:XaS$US3OS%/UQ73n[OUS&US US US 35eUVs/sH nUcMUPM nn[!U5S:XaSnU$UnU$s snf![2Gan[%U[45(a$[%U[65(d[US35Ue[%U[85(a[USUS35Ue[%U[:5(a[SUR<SUS35UeUVs/sHn[?UUX'5PM Os snfnn[ASU55(aUsSnA$[%U[65(a'U (dSnAg[SUS[U535Ue[%U[B5(a-U(dSnAgU (a[S[DS 35UeSnAGNd[%U[F5(a2[%U[H5(dU(dSnAg[S!US"U35e[%U[H5(dUeSnAGNSnAff=fs snfs snnfs snf)'a Tries to locate several files in a local folder and repo, downloads and cache them if necessary. Args: path_or_repo_id (`str` or `os.PathLike`): This can be either: - a string, the *model id* of a model repo on huggingface.co. - a path to a *directory* potentially containing the file. filenames (`List[str]`): The name of all the files to locate in `path_or_repo`. cache_dir (`str` or `os.PathLike`, *optional*): Path to a directory in which a downloaded pretrained model configuration should be cached if the standard cache should not be used. force_download (`bool`, *optional*, defaults to `False`): Whether or not to force to (re-)download the configuration files and override the cached versions if they exist. resume_download: Deprecated and ignored. All downloads are now resumed by default when possible. Will be removed in v5 of Transformers. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. token (`str` or *bool*, *optional*): The token to use as HTTP bearer authorization for remote files. If `True`, will use the token generated when running `huggingface-cli login` (stored in `~/.huggingface`). revision (`str`, *optional*, defaults to `"main"`): The specific model version to use. It can be a branch name, a tag name, or a commit id, since we use a git-based system for storing models and other artifacts on huggingface.co, so `revision` can be any identifier allowed by git. local_files_only (`bool`, *optional*, defaults to `False`): If `True`, will only try to load the tokenizer configuration from local files. subfolder (`str`, *optional*, defaults to `""`): In case the relevant files are located inside a subfolder of the model repo on huggingface.co, you can specify the folder name here. repo_type (`str`, *optional*): Specify the repo type (useful when downloading from a space for instance). Private args: _raise_exceptions_for_gated_repo (`bool`): if False, do not raise an exception for gated repo error but return None. _raise_exceptions_for_missing_entries (`bool`): if False, do not raise an exception for missing entries but return None. _raise_exceptions_for_connection_errors (`bool`): if False, do not raise an exception for connection errors but return None. _commit_hash (`str`, *optional*): passed when we are chaining several calls to various files (e.g. when loading a tokenizer or a pipeline). If files are cached for this commit hash, avoid calls to head and get from the cache. Passing `token=True` is required when you want to use a private model. Returns: `Optional[str]`: Returns the resolved file (to the cache folder if downloaded from a repo). Examples: ```python # Download a model weight from the Hub and cache it. model_weights_file = cached_file("google-bert/bert-base-uncased", "pytorch_model.bin") ``` use_auth_tokenNrThe `use_auth_token` argument is deprecated and will be removed in v5 of Transformers. Please use `token` instead.V`token` and `use_auth_token` are both specified. Please set only the argument `token`.z+Offline mode: forcing local_files_only=TrueTrz config.jsonmainz& does not appear to have a file named z#. Checkout 'https://huggingface.co/z/tree/z' for available files.r)rErFrr$zCould not locate z inside .) rrrFrErrrrrrK) allow_patternsrrFrErrrrrrKa is not a local folder and is not a valid model identifier listed on 'https://huggingface.co/models' If this is a private repository, make sure to pass a token having permission to this repo either by logging in with `huggingface-cli login` or by passing `token=` is not a valid git identifier (branch name, tag name or commit id) that exists for this model name. Check the model page at 'https://huggingface.co/' for available revisions.zPermissionError at z when downloading z. Check cache directory permissions. Common causes: 1) another user is downloading the same model (please wait); 2) a previous download was canceled and the lock file needs manual removal.c3(# UHoSLv M g7fr0r2rrs r4rcached_files.. s;ND4Nz`You are trying to access a gated repo. Make sure to have access to it at https://huggingface.co/z. zWe couldn't connect to 'z' to load the files, and couldn't find them in the cached files. Checkout your internet connection or see how to run the library in offline mode at 'https://huggingface.co/docs/transformers/installation#offline-mode'.z:There was a specific connection error when trying to load z: c3(# UHoSLv M g7fr0r2rs r4rr3s 3ND4>-008XV_anIo=o*2*:I!*++QRZQ[\33B2C6)Tjl   ! !- 0# >c.11& )T"" N NL&H2YajM( (88 A%L"))-8> A%L!$5hZxGXXY"Z[['s>**!$^!4q!8~BdB ,JZ ~ ! # ! "%i.A"5$9#!#%- /!1  -#!#%- /!1 VcqbpV^!/8YQbp 3N 3338]>A.R`>av>a(:(em8>av ~ ! #(:bggll9Vc>d(d&.FH 474HA4MmOA./ 0UabudsbuavSw 8=`ap`qqwyBxCC$ $  (6J~td~NJ 0A5TN U>+ U06BU+ Q$# U+U0 U+*7U+&U+1U+=(U++U0c[R"SUS3[5 [R"5up#[ R "US5n[XUS9 SSS5 U$!,(df  U$=f)aO Downloads a given url in a temporary file. This function is not safe to use in multiple processes. Its only use is for deprecated behavior allowing to download config/models with a single url instead of using the Hub. Args: url (`str`): The url of the file to download. proxies (`Dict[str, str]`, *optional*): A dictionary of proxy servers to use by protocol or endpoint, e.g., `{'http': 'foo.bar:3128', 'http://hostname': 'foo.bar:4012'}.` The proxies are used on each request. Returns: `str`: The location of the temporary file where the url was downloaded. z5Using `from_pretrained` with the url of a file (here aY) is deprecated and won't be possible anymore in v5 of Transformers. You should host your file on the Hub (hf.co) instead and use the repository ID. Note that this is not compatible with the caching system (your file will be downloaded at each execution) or multiple processes (each process will download the file in a different temporary file).wb)rN)rrrtempfilemkstempr|fdopenr)urlrtmp_fdtmp_filefs r4 download_urlrJsn MM ?uEc c   '')F 64 A) ! O ! Os  A## A2)rKrEr path_or_repoc URSS5n U b+[R"S[5 Ub [ S5eU n[ R RU5(a<[ R R[ R RX55$[UUUUUS9n [U [5n U(aU $[5R[XX'S9[!U[#5S9SUS S 9n [3U 5 g ![$R&R([$R&R*4a e[$R&R,[$R&R.[04a U s$f=f![4a,n [6R9U 5 [;US US 35U eSn A f[<a)n [6R9U 5 [;US35U eSn A f[>a,n [6R9U 5 [;USUS35U eSn A f[@a g[$RBa U s$f=f)a Checks if a repo contains a given file without downloading it. Works for remote repos and local folders. If offline mode is enabled, checks if the file exists in the cache. This function will raise an error if the repository `path_or_repo` is not valid or if `revision` does not exist for this repo, but will return False for regular connection errors. rNrr)rJrrFrrE)rrFr)rrF )headersallow_redirectsrtimeoutTzN is a gated repository. Make sure to request access at https://huggingface.co/z and pass a token having permission to this repo either by logging in with `huggingface-cli login` or by passing `token=`.zE is not a local folder or a valid repository name on 'https://hf.co'.rr)"rrrrrr|rRrrrrrrr headrrrrz exceptionsSSLError ProxyErrorrUTimeoutrr!rrerrorrrrrr#)rrrFrrrKrErrr cached_pathhas_file_in_cacheresponsers r4has_fileres;0'**+;TBN!  A    uv v ww}}\""ww~~bggll<BCC ) K#;4  !=%% | _$5_=NO! & "!H%    ( ((*=*=*H*H I ++## ! ! !  Qn&&2^4Z Z    #u Q&klmstt  QjKKW.Xr t      !  !sO3D< FA7FF I'F66 I$G'' I4'H I*IIc\rSrSrSrSS\S\\S\\\\4S\\S\\S \4 S jjr S \\\ R44S jr SS \\\ R4S\S \ \\4S\\S\\\\4S\S\\S\\4SjjrSS\S\\S\\S\\S\\\\4S\\\\4S\S\S\\S\\S\\\S \4SjjrSrg)PushToHubMixinizO A Mixin containing the functionality to push a model or tokenizer to the hub. NrJprivaterrepo_url organizationrLcPUb=[R"S5 Ub [S5eUR[S3S5nUbM[R"S5 UR U5(d!SU;aUR S5SnUSU3n[XUSS9nUR$) zy Create the repo if needed, cleans up repo_id with deprecated kwargs `repo_url` and `organization`, retrieves the token. zgThe `repo_url` argument is deprecated and will be removed in v5 of Transformers. Use `repo_id` instead.zT`repo_id` and `repo_url` are both specified. Please set only the argument `repo_id`.rPrzThe `organization` argument is deprecated and will be removed in v5 of Transformers. Set your organization directly in the `repo_id` passed instead (`repo_id={organization}/{model_id}`).T)rJrrexist_ok) rrrreplacerA startswithrrrJ)selfrJrrrrrs r4 _create_repoPushToHubMixin._create_repos   MM " j&&*I)J!'LbQG  # MMo %%l33'>%mmC04G)N!G95'RVW{{r3 working_dirc [R"U5Vs0sH?o"[RR[RR X55_MA sn$s snf)zC Returns the list of files with their last modification timestamp. )r|listdirrRgetmtimer)r rrs r4_get_files_timestamps$PushToHubMixin._get_files_timestampssILN::VaKbcKba277##BGGLL$@AAKbcccsAA"files_timestampscommit_message create_prrFcommit_descriptionc UcSURR;aSnOSURR;aSnOpSURR;aSnOSSURR;aS nO6S URR;aS nOS URR3n[R"U5V s/sHNn X;dD[RR [RR X55X9:dMLU PMP n n U V s/sHn [RR[RR X55(dC[RR[RR X55(dMU PM n n /n U GH n [RR[RR X55(a[R"[RR X55HWn U R[[RR XU 5[RR X5S 95 MY MU R[[RR X5U S 95 GM Ub"URS5(d [X'USS9 [ R#SUSSR U 535 [%UU UUUUUS9$s sn fs sn f![a,n U RRS:Xa U(aSn A NseSn A ff=f)zX Uploads all modified files in `working_dir` to `repo_id`, based on `files_timestamps`. NModelz Upload modelConfigz Upload config TokenizerzUpload tokenizerFeatureExtractorzUpload feature extractor ProcessorzUpload processorzUpload )path_or_fileobjrNzrefs/prT)rJbranchrr iz!Uploading the following files to z: ,)rJ operationsrrrrrF) __class____name__r|rrRrrrrrr r rrr status_coderrr)r rrJrrrrrFrrmodified_filesr"rrs r4_upload_modified_files%PushToHubMixin._upload_modified_filess  !$..111!/T^^444!0 7 77!3#t~~'>'>>!; 7 77!3#*4>>+B+B*C!DZZ , ,(BGG,<,rB% ,%mmC04 "--,R0K%((T:(,,^TB ## EHS_$  /    !ww}}[99L [| TX`#99(C  $$#1'9%) %$$Xn$t OOBGGLL;? @.. -#!#5/ #U T Ts BH H*r2)NNNN)NNFNN) NNNN5GBFTNNN)r$ __module__ __qualname____firstlineno____doc__rrboolrr r|PathLikerrfloatr'intlistr8__static_attributes__r2r3r4rrs#',0"&&* !!$!dCi() ! 3- ! sm ! !FdsBKK7G1Hd)-,0"&,0M 3 +,M M sEz* M ! M dCi() M M 3-M %SMM d(,(,"&,049#'"&,0$(RRtnR! R $ R dCi() R!sCx1RR!R3-R%SMRtCy!R RRr3rpytorch) frameworkcR[5(agXS.nUHnURR5VVs0sH$upVURS5(aMUcM"XV_M& nnnSU;a1USn[R R U5(dUSUS'SU;a USUS'MSU;dMURSS 5RS S 5RS S 5n U RS S 5n U S US3US'M [SS[[U5S9 gs snnf)a Sends telemetry that helps tracking the examples use. Args: example_name (`str`): The name of the example. *example_args (dataclasses or `argparse.ArgumentParser`): The arguments to the script. This function will only try to extract the model and dataset name from those. Nothing else is tracked. framework (`str`, *optional*, defaults to `"pytorch"`): The framework for the example. N)examplerF_model_name_or_path model_name dataset_name task_nametf_rflax_run_ _no_trainer-examples transformers)topic library_namelibrary_versionr) r5__dict__rr r|rRrr r"r%r) example_namerF example_argsdataargsrr args_as_dictrK script_names r4send_example_telemetryr_s,# j)>allSVFW\])> j < /%&:;J77==,,%12F%G\" \ )#/#?D L (&..ub9AA'2NVVW]_abK%--mR@K&1]!L4M3N#OD  ~{_nos_tksD#D#D#sizecp[U[5(aU$UR5RS5(a[USS5S-$UR5RS5(a[USS5S-$UR5RS5(a[USS5S-$UR5RS 5(a.[USS 5S -nURS 5(aUS -$U$UR5RS5(a.[USS 5S-nURS 5(aUS -$U$UR5RS5(a.[USS 5S-nURS 5(aUS -$U$[ S5e)a Converts a size expressed as a string with digits an unit (like `"5MB"`) to an integer (in bytes). Args: size (`int` or `str`): The size to convert. Will be directly returned if an `int`. Example: ```py >>> convert_file_size_to_int("1MiB") 1048576 ``` GIBNi@MIBiKIBiGBiʚ;bMBi@BKBizR`size` is not in a valid format. Use an integer followed by the unit, e.g., '5GB'.)rrBrrSr)r`int_sizes r4convert_file_size_to_intrms~$  zz|U##49~'' zz|U##49~'' zz|U##49~'' zz|T""tCRy>U+ $ c 2 2x1}@@ zz|T""tCRy>U+ $ c 2 2x1}@@ zz|T""tCRy>U+ $ c 2 2x1}@@ i jjr3c  (SSKn U RSS5nUb+[R"S[5 Ub [ S5eUn[ RRU5(d[ SUSUS35e[U5nU R"UR55nSSS5 [[WS R555nUS n[US R!55US 'US R#5US '[ RR%U5(a4UVs/sH#n[ RR'X U5PM% nnUU4$[)UUUUUUUUUU U U S 9 nUU4$!,(df  N=fs snf) a For a given model: - download and cache all the shards of a sharded checkpoint if `pretrained_model_name_or_path` is a model ID on the Hub - returns the list of paths to all the shards, as well as some metadata. For the description of each arg, see [`PreTrainedModel.from_pretrained`]. `index_filename` is the full path to the index (downloaded and cached if `pretrained_model_name_or_path` is a model ID on the Hub). rNrrrzCan't find a checkpoint index (z) in r weight_mapmetadataall_checkpoint_keys) rErrrrKrrrFrr)r~rrrrrr|rRropenrreadsortedsetvaluesrCkeyscopyrrr)pretrained_model_name_or_pathindex_filenamerErrrrKrrrFrrrr~rrindexshard_filenamessharded_metadatacached_filenamess r4get_checkpoint_shard_filesrs2&**+;TBN!  A    uv v 77>>. ) ):>:J%PmOnnopqq n  1668$ S|!4!;!;!=>?OZ(.253F3K3K3M.N*+%*<%8%=%=%?\" ww}}233^mn^mYZ277<<(ERST^mn 000$%%')!  - --=  os!E>6*F> F r,r.c[R"XUS9nUbqUR R c/UR lUHCnXtR R ;dMUR R RU5 ME U$![a( Sn[Uc/OUSS9n[R"XeS9nNf=f)aW Creates or loads an existing model card and tags it. Args: repo_id (`str`): The repo_id where to look for the model card. tags (`List[str]`, *optional*): The list of tags to add in the model card token (`str`, *optional*): Authentication token, obtained with `huggingface_hub.HfApi.login` method. Will default to the stored token. ignore_metadata_errors (`bool`, *optional*, defaults to `False`): If True, errors while parsing the metadata section will be ignored. Some information might be lost during the process. Use it at your own risk. r1uThis is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.rT)r,rV)model_description)r loadrr from_templater[r,r)rJr,rr.r6r card_data model_tags r4r3r3hs(]^^GQgh   ??   '#%JOO I 4 44$$++I6  ]e!T\rtR`a ,,Y\ ]sB /B?>B?c^\rSrSrSrS S\\RSS4SjjrSr Sr S S jr S r g) PushInProgressizb Internal class to keep track of a push in progress (which might contain multiple `Future` jobs). NjobsrLc(Uc/UlgUUlgr0r)r rs r4__init__PushInProgress.__init__s,B D r3c:[SUR55$)Nc3@# UHoR5v M g7fr0)done)rjobs r4r)PushInProgress.is_done..s3#88::s)rrr s r4is_donePushInProgress.is_dones3333r3cD[R"UR5 gr0)rwaitrrs r4wait_until_donePushInProgress.wait_until_dones TYYr3cURVs/sH3nUR5(aMUR5(aM1UPM5 snUlgs snfr0)rcancelr)r rs r4rPushInProgress.cancelsEyy  JJL %(HHJ     sAAArr0)rLN) r$r;r<r=r>rrFuturerrrrrDr2r3r4rrs21Xgnn5114  r3r)NNr0)NFNNNNFrNNTTTN)NNN) NFNNFNNNrN)NNF)xr>r~r|rrrr concurrentrpathlibrtypingrr urllib.parseruuidrhuggingface_hubrzr r r r r rrrrrrrrhuggingface_hub.file_downloadrrhuggingface_hub.utilsrrrrrrrrr r!r"requests.exceptionsr#rr%r&genericr' import_utilsr(r)r*r+r,r-#LEGACY_PROCESSOR_CHAT_TEMPLATE_FILECHAT_TEMPLATE_FILErQ get_loggerr$rHF_HUB_OFFLINEr1r5rrRrtorch_cache_homedefault_cache_path HF_HUB_CACHEr9r:r;HF_HOMEr< TRANSFORMERS_DYNAMIC_MODULE_NAMEhexrkeyrrS3_BUCKET_PREFIXCLOUDFRONT_DISTRIB_PREFIXr}r{r _staging_mode_default_endpointrAHUGGINGFACE_CO_PREFIX!HUGGINGFACE_CO_EXAMPLES_TELEMETRYrrIr?rCr^rerrrrr@rrrrrr_rBrmrr3rr2r3r4rs "!F    *"(';#*/   H %",,;;99\277<< BRT^8_ah+ij11!# *I9KaKa bYY'CEbcYY35OP99/i>O>OQZ1[\#9 W[[  aC yy~! cUk l   aI8 7>DDFJ^^ 7D3Jb"3::>>3T:F MM 6 ')jjnn5VX\&]#"$**..@_"`7:ee$CF_$_!sw),9>sD$9Objknbo## %r %r%rsm %r } %r  #Y %rP. 4dCo 6#. Ix} I8C= IU]^aUb I<3 +,<<c] <D48 &*(,(,""#7;-12648"&!J3 +,JCyJc2;;./0J J d^ J d38n % J E$)$ %JsmJJJ}JsDcN234J'+J,0J.2J 3-!J$c]%JZ<#(,(, a!#(,#a!R[[()a!a!sma!d38n % a! E$)$ % a!a!S$_%a!}a!HOOdCL Fk5c?kH   F.V!%#( % % 49 % C=%! %P  r3