fThw SrSSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK r SSK r SSK r SSK r SSK Jr SSKJr SSKJr SSKJr SSKJr SSKJrJrJrJrJrJrJrJr SS K J!r! S S K"J#r# \#RH"\%5r&GSS \'S\(S\\\(\'4\(44Sjjr)1Skr*\*RWS15r,\RZR]SS5R_5r0\RZR]SS5R_5r1\RZR]SS5R_5r2\RZR]SS5R_5r3\RZR]SS5R_5r4\!Rj"S5r6Sr7Sr8Sr9Sr:Sr;SrS"r?\)"S#S$S%9ur@rA\)"S&5rB\)"S'5rC\)"S(5rD\)"S)S$S%9urErF\RRS*5SLrI\RRS+5SLrJ\)"S,5rK\)"S-5rL\)"S.5rM\)"S/5rN\)"S05rO\)"S15rP\)"S2S$S%9urQrR\RRS35SLrS\)"S45rT\RRS55SLrU\RRS65SLrV\)"S75rW\)"S85rX\RRS95SLrY\RRCS95r[\&RS:\[35 \)"S=5r^\)"S>5r_\)"S?5r`\)"S@S$S%9urarb\)"SA5rc\)"SB5rd\)"SC5re\)"SD5rf\)"SE5rg\)"SF5rh\)"SG5ri\)"SH5rj\)"SI5rk\)"SJ5rl\)"SK5rm\)"SL5rn\)"SM5ro\)"SNS$S%9urprq\RRSO5SLrr\)"SP5rsS rt\RRCSQ5 S$rt\RRSR5SLru\)"SS5rv\)"ST5rw\)"SU5rx\)"SV5ry\)"SW5rz\)"SX5r{\)"SY5r|\)"SZ5r}\)"S[5r~\)"S\5r\)"S]5r\)"S^5r\)"S_5r\)"S`5r\)"Sa5r\)"Sb5r\)"Sc5r\)"SdS$S%9urr\RRSe5SLr\(a\RRCSf5 \RRSg5SLr\)"Sh5r\)"Si5r\)"SjS$S%9urr\)"Sk5r\)"Sl5r\)"Sm5r\)"Sn5r\)"So5r\)"Sp5r\)"SqS$S%9urr\)"Sr5r\)"SsS$S%9urr\)"St5r\)"Su5r\)"SvS$S%9urr\)"Sw5r\)"Sx5r\)"Sy5r\)"Sz5r\)"S{5r\)"S|5r\)"S}5rS~rS r\1\,;aY\0\*;aS\)"SS$S%9urr\(aA\!Rj"\5\!Rj"S5:r\(d\&GROS\35 O\&GRQS5 S rS~rS r\4\*;aS$rO\0\,;a\1\*;a\RRS5SLr\(a-SrSr\Hr\RRC\5r O \SLr\(a>\!Rj"\5\!Rj"S5:a\&GRQS\S35 S rO\&GRQS5 \RRS5SLr\RRCS5r\&RS\35 \RRS5SLr\RRCS5r\&RS\35 S~r\RRS5SL=(d \RRS5SLr\RRCS5r\&RS\35 S r\2\,;aD\)"SS$S%9urr\(a3\)"SS$S%9urr\(a\&GRQS\S\S35 OS =rrS~=rrS r\3\*;a'\)"SS$S%9urr\(a\&GRQS\S35 SrSrSrSrSr\74S\'4SjjrSrSrSr\<4S\'4SjjrSrSrSrSrSrSrSrSrSrSr\84S\'4SjjrSrSrSrSrSrSrSrSrSrGSS\\'4SjjrS\(4SjrS\(4SjrSr\"5S5r\"5S5rSrSrSrSrSrSrSrSrSrSrSrSrSr\GSSj5r\"5GSSj5r\"5GSSj5r\"5GSSj5r\"5GSSj5r\S5r\S5rSrSrSrSrSrSrSrSrSrSrSrSrSr\=4S\'4SjjrSrSGrSGrGSS\'4SjjGr\GSSj5Gr\"5S5GrS\(4SjGrSGr\"5S5Gr\"5S\'4Sj5Gr\"5GSS\'S\(4Sjj5Gr \"5GSS\'S\(4Sjj5Gr SGr SGr SGr SGrSGrSGr\:4S\'4SjjGrSGr\94S\'4SjjGrSGrSGr\?4S\'4SjjGrSGrSGrSGrSGrSGrSGrSGrGSGrGSGrGSGr GSGr!\GS5Gr"GSGr#GSGr$GSGr%GSGr&GS Gr'GS Gr(GS Gr)GS Gr*GS Gr+GSGr,GSGr-GSGr.GSGr/GSGr0GSGr1GSGr2GSGr3\>4S\'4GSjjGr4GSGr5GSGr6GSGr7GSGr8GSGr9GSGr:GSGr;GSGrGS!Gr?GS"Gr@GS#GrAGS$GrBGS%GrCGS&GrDGS'GrEGS(GrFGS)GrGGS*GrHGS+GrIGS,GrJGS-GrKGS.GrLGS/GrMGS0GrNGS1GrOGS2GrPGS3GrQGS4GrRGS5GrSGS6GrTGS7GrUGS8GrVGS9GrWGS:GrXGS;GrYGSGr\GS?Gr]GS@Gr^GSAGr_GSBGr`GSCGraGSDGrbGSEGrcGSFGrdGSGGreGSHGrfGSIGrgGSJGrhGSKGriGSLGrjGSMGrkGSNGrlGSOGrmGSPGrnGSQGroGSRGrpGSSGrqGSTGrrGSUGrsGSVGrtGSWGruGSXGrvGSYGrwGSZGrxGS[Gry\"/S*\G\I44PS3\G\V44PS5\G\L44PS7\G\M44PS+G\G\K44PS8\G\Y44PS\G\r44PS9G\ G\Q44PS\G\Z44PS=\G\[44PS>\G\]44PSSG\+G\b44PSUG\7G\c44PSVG\8G\d44PS\G\t44PGS\G\G\\44PSF\G\s44PGS]G\G\P44PSY\G\o44PS[G\#G\n44PS_\G\e44PS]G\)G\^44PSbG\G\O44PSeG\G\W44PGS^G\5G\h44PSkG\*G\_44PGS_\G\X44PSlG\&G\`44PSnG\0G\i44PSpG\3G\a44PSGG\1G\j44PSHG\2G\l44PSoG\!G\N44PS\G\R44PSs\G\S44PGS`G\"G\m44PSaG\ G\f44PS#\G\p44PSG\:G\q44PGSaG\?G\u44PSAG\@G\v44PST\G\w44PGSbG\AG\x44PS6\G\J44PS|G\GG\y44PSDG\'G\g44P5GrzGScGr{"GSdGSeG\|5Gr}GSfGr~\\'Gr\G\\\'\\'44Gr"GSgGSh\5Gr"GSiGSjG\5GrGSGSk\'S\4GSljjGr"GSmGSn\5Gr\"5S\\'\'\'44GSoj5Gr"GSpGSq5GrGSrGSs.GStjGrGSuGSvGSwGSxGSyGSzGS{GS|GS}GS~GSGS0GrGSGr\"5GS5GrGSGr\"5GSGS\'GS\\'SG\4GSjj5GrGSGrg!\RRa \RRCS;5r[\&RS:\[35 G N!\RRaZ \RRCS<5r[\&RS:\[35 G NM!\RRa S rYG Nnf=ff=ff=f!\RRa S rtG Nf=f!\RRa S rG Nf=f!\RRa G Mf=f!\RRa S rGNf=f!\RRa S rGNf=f!\RRa S rGNdf=f(zD Import utilities: Utilities related to imports and our lazy inits. N) OrderedDict)Enum) lru_cache)chain) ModuleType)AnyDict FrozenSetListOptionalSetTupleUnion)version)loggingFpkg_namereturn_versionreturnc@[RRU5SLnSnU(a;[RR U5n[RS US U35 U(aX#4$U$![RR a US:XaG[R "U5n[USS5nSU;aUnSnN{SnN![a SnNf=fUS:Xa5[RR S5nN![a SnNf=fSnNf=f) NN/Atorch __version__devTFquarkz amd-quarkz Detected z version: ) importlibutil find_specmetadatarPackageNotFoundError import_modulegetattr ImportError Exceptionloggerdebug)rrpackage_existspackage_versionpackage temp_versions W/var/www/auris/envauris/lib/python3.13/site-packages/transformers/utils/import_utils.py_is_package_availabler,-s!^^--h7tCNO '(0088BO2  y *_4EFG..9!!66 '7" +'55h?G#*7M5#IL ,*6)-)."+%*N+W$+&/&8&8&@&@&MO +%*N+"'/ 'sSA22$D-C C  CDC D$D DDDDD>1ONYESTRUEAUTOUSE_TF USE_TORCHUSE_FLAX USE_TORCH_XLAr-FORCE_TF_AVAILABLEz1.10z0.26.0z1.2.6z1.12.0z0.10.0z2.2.0z0.2.1z0.0.4z0.4.0z0.5.0 accelerateT)rapex apollo_torchaqlmvptqavdecord bitsandbyteseetq fbgemm_gpu galore_torch lomo_optim grokadamw schedulefreebs4 coloredlogscv2yt_dlpdatasets detectron2faissz$Successfully imported faiss version z faiss-cpuz faiss-gpuftfyg2p_enfast_hadamard_transformintel_extension_for_pytorchjiebajinja2kenlm keras_nlp Levenshteinlibrosanattennltkonnxopenaioptimum auto_gptq gptqmodel auto_roundawqroptimum_quantocompressed_tensorspandaspeft phonemizeruromanpsutilpy3nvml pyctcdecodepygments pytesseractpytestpytorch_quantizationrjieba sacremoses safetensorsscipy sentencepieceseqioggufsklearnz scikit-learn smdistributed soundfilespacy sudachipytensorflow_probabilitytensorflow_texttf2onnxtimm tokenizers torchaudiotorchao torchdistx torchvisionmlx num2wordshqqtiktokenblobfile liger_kerneltriton spqr_quantrichkernelsrr2.1.0z?Disabling PyTorch because PyTorch >= 2.1 is required but found z'Disabling PyTorch because USE_TF is set tensorflow) rztensorflow-cpuztensorflow-gpuz tf-nightlyztf-nightly-cpuztf-nightly-gpuztf-nightly-rocmzintel-tensorflowzintel-tensorflow-avx512ztensorflow-rocmztensorflow-macosztensorflow-aarch642z"TensorFlow found but with version z*. Transformers requires version 2 minimum.z-Disabling Tensorflow because USE_TORCH is setessentiaz'Successfully imported essentia version pretty_midiz*Successfully imported pretty_midi version torch_ccloneccl_bindings_for_pytorchoneccl_bind_ptz Detected oneccl_bind_pt version flaxjaxz JAX version z, Flax version z available. torch_xlazTorch XLA version c[$N)_kenlm_availabler+is_kenlm_availablerL rc[$r)_kernels_availablerrr+is_kernels_availablerP rc[$r)_cv2_availablerrr+is_cv2_availablerT rc[$r)_yt_dlp_availablerrr+is_yt_dlp_availablerX rc[$r)_torch_availablerrr+is_torch_availabler\rr min_versionc~[=(a1 [R"[5[R"U5:$r)_accelerate_availablerparse_accelerate_versionrs r+is_accelerate_availabler`& eW]]3F%G7==YdKe%eercB[5(aSSKn[US5$g)Nr acceleratorF)rrhasattrrs r+is_torch_accelerator_availablerdsum,, rcV[5(aSSKnUR5S:Xaggg)zz Check whether pytorch uses deterministic algorithms by looking if torch.set_deterministic_debug_mode() is set to 1 or 2" rNFT)rrget_deterministic_debug_moders r+is_torch_deterministicrms*  - - /1 4 rc[$r)_hadamard_availablerrr+is_hadamard_availabler| rc~[=(a1 [R"[5[R"U5:$r)_hqq_availablerr _hqq_versionrs r+is_hqq_availablers$  WgmmL9W]];=WWWrc[$r)_pygments_availablerrr+is_pygments_availablerrrc[$r)_torch_versionrrr+get_torch_versionrrrc[5(dg[S:Xag[5(ag[5(ag[R "[5[R "S5:$)NFrTz2.1.1)rris_torch_mlu_availableis_torch_npu_availablerrrrr+is_torch_sdpa_availablersP    5  == (GMM',B BBrc[5(dg[S:Xag[R"[5[R"S5:$)NFrz2.5.0)rrrrrrr+is_torch_flex_attn_availablers8    5  == (GMM',B BBrc[$r)_torchvision_availablerrr+is_torchvision_availabler !!rc[5(dg[R"[5[R"S5:$)NFz0.15)rrr_torchvision_versionrrr+is_torchvision_v2_availablers. # % % ==- .'--2G GGrc[$r)_galore_torch_availablerrr+is_galore_torch_availabler ""rc[$r)_apollo_torch_availablerrr+is_apollo_torch_availablerrrc[$r)_lomo_availablerrr+is_lomo_availabler rc[$r)_grokadamw_availablerrr+is_grokadamw_availabler rc~[=(a1 [R"[5[R"U5:$r)_schedulefree_availablerr_schedulefree_versionrs r+is_schedulefree_availablers& " iw}}5J'Kw}}]hOi'iirc[$r)_pyctcdecode_availablerrr+is_pyctcdecode_availablerrrc[$r)_librosa_availablerrr+is_librosa_availablerrrc[$r)_essentia_availablerrr+is_essentia_availablerrrc[$r)_pretty_midi_availablerrr+is_pretty_midi_availablerrrc^[5(aSSKnURR5$gNrF)rrcuda is_availablers r+is_torch_cuda_availablers$zz&&((rc[5(a/SSKnURR5(dg[ S5$g)NrF mamba_ssmrrrrr,rs r+is_mamba_ssm_availablers2zz&&(((5 5 rc[5(aqSSKnURR5(dg[ S5(a=SSKn[ R"UR5[ R"S5:agg)NrFr2.0.4T) rrrrr,rrrr)rrs r+is_mamba_2_ssm_availablersXzz&&(($[11 ==!6!677==;QQ rc[5(a/SSKnURR5(dg[ S5$g)NrF causal_conv1drrs r+is_causal_conv1d_availablers2zz&&(($_55 rc8[5(a [S5$g)NmambapyF)rr,rrr+is_mambapy_availablers$Y// rc[5(aSSKn[URS5(aURRR 5=(a$ URRR 5nUb<[R"[5[R"U5:nU=(a UnU$g)NrmpsF) rrrbackendsr ris_builtrrr)rrbackend_availableflags r+is_torch_mps_availabler s 5>>5 ) ) % 2 2 ? ? A cennFXFXFaFaFc &}}^4 k8RR$5$>$!$ $ rcb[5(dgSSKnURR5(aURR 5$[ 5(aUR R 5$[5(ag[5(aURR 5$g)NFrT) rrrris_bf16_supportedis_torch_xpu_availablexpuis_torch_hpu_availablernpurs r+is_torch_bf16_gpu_availablers~    zz  zz++--yy**,,yy**,, rc[5$rrrrr+is_torch_bf16_cpu_availabler(  rcL[R"S[5 [5$)NzThe util is_torch_bf16_available is deprecated, please use is_torch_bf16_gpu_available or is_torch_bf16_cpu_available instead according to whether it's used with cpu or gpu)warningswarn FutureWarningrrrr+is_torch_bf16_availabler,s$ MM ` ' ((rcT[5(dg[5(a[5(aggSSKnUR SSUR US9nX"-nSupEnUR XEXaR US9nURRXaR US9nU"U5ng! g=f)NFTrdtypedevice)) rris_habana_gaudi1rzerosfloat16randnnn LayerNorm) r#rx_batchsentence_length embedding_dim embedding layer_norms r+!is_torch_fp16_available_on_devicer47s       KK1EMM&K A E18- KK ]]ciKj XX'' ]]SY'Z y !  s A,B##B'c[5(dgSSKnUS:Xa [5$US:XagURSSURUS9nX"-ng! g=f)NFrrhpuTr r!)rrrr(bfloat16)r#rr-r.s r+!is_torch_bf16_available_on_devicer8Wsc    *,,  KK1ENN6K B E  s AAc[5(dgSSKnURR5(aURRcgURR URR 55RS:agg)NFrT)rrrrrget_device_propertiescurrent_devicemajorrs r+is_torch_tf32_availabler>osf    :: " " $ $ (:(:(B zz'' (A(A(CDJJQN rc[5$rrrrr+is_torch_fx_availabler@|rrc[$r)_peft_availablerrr+is_peft_availablerCrrc[$r)_bs4_availablerrr+is_bs4_availablerFrrc[$r) _tf_availablerrr+is_tf_availablerI rc[$r)_coloredlogs_availablerrr+is_coloredlogs_availablerMrrc[$r)_tf2onnx_availablerrr+is_tf2onnx_availablerPrrc[$r)_onnx_availablerrr+is_onnx_availablerSrrc[$r)_openai_availablerrr+is_openai_availablerVrrc[$r)_flax_availablerrr+is_flax_availablerYrrc[RRS5SL=(a" [RR S5S:$![RR a gf=f)Nflutez flute-kernelz0.4.1F)rrrrrr rrr+is_flute_availabler\s\~~''0<vASASA[A[\jAkovAvv    2 2sA A A-,A-c[$r)_ftfy_availablerrr+is_ftfy_availabler_rrc[$r)_g2p_en_availablerrr+is_g2p_en_availablerbrrcU(aU(aS5e[(dgSSKnU(aURR5S;$U(aURR5S:H$g)z Check if `torch_xla` is available. To train a native pytorch job in an environment with torch xla installed, set the USE_TORCH_XLA to false. z6The check_is_tpu and check_is_gpu cannot both be true.FrN)GPUCUDATPUT)_torch_xla_availablerruntime device_type) check_is_tpu check_is_gpurs r+is_torch_xla_availablerls^ h0hh .    ,,./AA   ,,.%77 rcX[RRS5b [5$g)N torch_neuronxF)rrrrl) check_devices r+is_torch_neuroncore_availablerps#~~0<%'' rc\[(a [RRS5cgSSKnSSKnU(a5UR R5nUR R5$[US5=(a UR R5$![a gf=f)zQChecks if `torch_npu` is installed and potentially if a NPU is in the environment torch_npuNFrr) rrrrrrrr device_countr RuntimeErrorr)rorrrr.s r+rrs  y~~77 DL  &&(A99))+ + 5% =UYY%;%;%==  s3B B+*B+c[(a [RRS5cgSSKnSSKn[ RRS5n[S5[ RS'URR5nU(aU[ RS'U$[ RRSS5 U$!U(aU[ RS'f[ RRSS5 f=f)zv Checks if `mlu` is available via an `cndev-based` check which won't trigger the drivers and leave mlu uninitialized. torch_mluNFrPYTORCH_CNDEV_BASED_MLU_CHECKr) rrrrrrvosenvirongetstrmlurpop)rorrv,pytorch_cndev_based_mlu_check_previous_value availables r+rrs  y~~77 DL35::>>Ba3b0B69!f 23II**, 7:fBJJ6 7  JJNN:D A  8:fBJJ6 7 JJNN:D As 6C =Dc[(a [RRS5cgSSKnSSKnSn[ (a3[R"[5[R"U5:agU(a5URR5nURR5$[US5=(a URR5$![a gf=f)zSChecks if `torch_musa` is installed and potentially if a MUSA is in the environment torch_musaNFrz0.33.0musa)rrrrrrrrrrrrsrrtr)rorrtorch_musa_min_versionr.s r+is_torch_musa_availablers  y~~77 EM%/B!CgmmTjFk!k  '')A::**, , 5& ! ?ejj&=&=&??  s=3C C+*C+c^^[(a@[RRS5b [RRS5cgSn[(a3[ R "[5[ R "U5:agSSKm[RRSS5S:XaSSK n[TS 5(aTRR5(dgSSKJs Js Jn UR'5UR(R*:Xa.TR,R.mUU4S jnUTR,lg ) zQChecks if `torch.hpu` is available and potentially if a HPU is in the environmenthabana_frameworksNzhabana_frameworks.torchFz1.5.0rPT_HPU_LAZY_MODEr-r6c>URTR:Xa[RS5 X U'gT"XU5 g)NzIn-place tensor.masked_fill_(mask, value) is not supported for int64 tensors on Gaudi1. This operation will be performed out-of-place using tensor[mask] = value.)r"int64r% warning_once)selfmaskvalueoriginal_masked_fill_rs r+patched_masked_fill_4is_torch_hpu_available..patched_masked_fill_/s:zzU[[(##`#T %d%8rT)rrrrrrrrrrxryrzhabana_frameworks.torchrr6r*habana_frameworks.torch.utils.experimentalutils experimental_get_device_type synDeviceTypesynDeviceGaudiTensor masked_fill_)torch_hpu_min_versionrhtexprrrs @@r+rrs   >> # #$7 8 @ >> # #$= > F#/B!CgmmTiFj!j zz~~(#.#5& 5%  (>(>(@(@>> 5#6#6#E#EE % 9 9 9%9 ! rc[5(dgSSKJs Js Jn UR 5UR R:H$NFr)rrrrrrrr)rs r+r'r'>s6 ! # #>>  ! ! #u':':'I'I IIrc[5$rrrrr+is_torchdynamo_availablerIrrc[5$rrrrr+is_torch_compile_availablerMrrc[5(dgSSKnURR5$![a+ SSKJn UR5s$![a gf=ff=fr)rrcompiler is_compilingr$ torch._dynamo_dynamordynamos r+is_torchdynamo_compilingrQsa    ~~**,,   *&&( (   ,0 A%AA% A!A% A!!A%c[5(dgSSKnURR5$![a+ SSKJn UR5s$![a gf=ff=fr)rrr is_exportingr$rrrs r+is_torchdynamo_exportingrdsa    ~~**,,   *&&( (   rc[RRS5cg[RRS5SL$)Ntorch_tensorrtFztorch_tensorrt.fxrrrrrr+is_torch_tensorrt_fx_availablerus6~~ 019 >> # #$7 8 DDrc[$r)_datasets_availablerrr+is_datasets_availabler{rrc[$r)_detectron2_availablerrr+is_detectron2_availabler  rc[$r)_rjieba_availablerrr+is_rjieba_availablerrrc[$r)_psutil_availablerrr+is_psutil_availablerrrc[$r)_py3nvml_availablerrr+is_py3nvml_availablerrrc[$r)_sacremoses_availablerrr+is_sacremoses_availablerrrc[$r)_apex_availablerrr+is_apex_availablerrrc[$r)_aqlm_availablerrr+is_aqlm_availablerrrc~[=(a1 [R"[5[R"U5:$r)_vptq_availablerr _vptq_versionrs r+is_vptq_availablers$  Yw}}];w}}[?YYYrc[$r) _av_availablerrr+is_av_availablerrJrc[$r)_decord_availablerrr+is_decord_availablerrrcn[R"SR55 g![a gf=f)z Code comes from *torch.utils.cpp_extension.is_ninja_available()*. Returns `True` if the [ninja](https://ninja-build.org/) build system is available on the system, `False` otherwise. zninja --versionTF) subprocess check_outputsplitr$rrr+is_ninja_availablers8  1 7 7 9: s $' 44c 2Sn[5(a [(dgU"[5nU"[5nX#:wa$[R SUSUS[S35 gU(a1[ R"[5[ R"U5:$g)Nc[[R"U5R5S-[[R"U5R5-$N.)r{rrr=minor) full_versions r+ get_major_and_minor_from_version;is_ipex_available..get_major_and_minor_from_versions;7==.445;c'--P\B]BcBc>dddrFzIntel Extension for PyTorch z needs to work with PyTorch z.*, but PyTorch z? is found. Please switch to the matching version and run again.T)r_ipex_availabler _ipex_versionr%warningrr)rrtorch_major_and_minoripex_major_and_minors r+is_ipex_availablerse   <^L;MJ4*+?*@@\]q\rs*++j l }}]+w}}[/III rc[5(dg[R"[5nURS:XaEUR S:a5[ 5(aSSKnO!URS:XaUR S:agSSKnU(a5URR5nURR5$[US5=(a URR5$![a gf=f)z Checks if XPU acceleration is available either via native PyTorch (>=2.6), `intel_extension_for_pytorch` or via stock PyTorch (>=2.4) and potentially if a XPU is in the environment. Fr rNr%r)rrrrr=rrrOrrrsrrtr)ro torch_versionrOrr.s r+rrs   MM.1MaM$7$7!$;    .  A %-*=*=*A  &&(A99))+ + 5% =UYY%;%;%==  s 3C-- C:9C:c [5(a [(dgSSKn[R"[ R RS55[R"S5:aURR5$g)NFrr>z0.43.1T) r_bitsandbytes_availablerrrrrrrrs r+is_bitsandbytes_availablers]   '>'>}}Y''//?@7==QYCZZzz&&(( rcZ[5(dgSSKnS[US[55;$)NFr multi_backendfeatures)rr>r"set)bnbs r+'is_bitsandbytes_multi_backend_availablers' $ & & gc:su= ==rc[5(dg[S5(dgSSKnURR 5(d[ 5(dgUR R(aJ[ R"[RR S55[ R"S5:$UR R(aJ[ R"[RR S55[ R"S5:$[ 5(aJ[ R"[RR S55[ R"S5:$g)NF flash_attnrrrz2.3.3) rr,rrrrrrrrhiprs r+is_flash_attn_2_availablers     . . JJ # # % %)?)A)A }}}}Y//77 EF'--X_J```   }}Y//77 EF'--X_J```  ! !}}Y//77 EF'--X_J```rc[S5(dg[R"[RRS55[R"S5:$)NrFrr,rrrrrrr+#is_flash_attn_greater_or_equal_2_10rs?  . . ==++33LA BgmmT[F\ \\rlibrary_versionc[S5(dg[R"[RRS55[R"U5:$)NrFr)rs r+is_flash_attn_greater_or_equalrs?  . . ==++33LA BgmmTcFd ddr accept_devc[S5(dgU(ah[R"[R"[RRS55R 5[R"U5:$[R"[RRS55[R"U5:$)z Accepts a library version and returns True if the current version of the library is greater than or equal to the given version. If `accept_dev` is True, it will also accept development versions (e.g. 2.7.0.dev20250320 matches 2.7.0). rFr,rrrr base_versionrrs r+is_torch_greater_or_equalr&s ! ) )}}W]]9+=+=+E+Eg+NO\\]ahanan b   }}Y//77@AW]]SbEcccrc[S5(dgU(ah[R"[R"[RRS55R 5[R"U5:$[R"[RRS55[R"U5:$)Nhuggingface_hubFrrs r+#is_huggingface_hub_greater_or_equalr8s !2 3 3}} MM),,445FG H U U ]]? +, ,}}Y//778IJKw}}]lOmmmrc[$r)_torchdistx_availablerrr+is_torchdistx_availabler Errc[$r)_faiss_availablerrr+is_faiss_availabler Irrc[$r)_scipy_availablerrr+is_scipy_availablerMrrc[$r)_sklearn_availablerrr+is_sklearn_availablerQrrc[$r)_sentencepiece_availablerrr+is_sentencepiece_availablerUs ##rc[$r)_is_seqio_availablerrr+is_seqio_availablerYrrc~[=(a1 [R"[5[R"U5:$r)_is_gguf_availablerr _gguf_versionrs r+is_gguf_availabler]s%  \'-- ">'--P[B\"\\rc[RRS5cg[RRS5SL$)NgoogleFzgoogle.protobufrrrr+is_protobuf_availableras5~~)1 >> # #$5 6d BBrc[5=(a1 [R"[5[R"U5:$r)rrrrrs r+is_fsdp_availabler!gs(   _GMM.$AW]]S^E_$__rc[$r)_optimum_availablerrr+is_optimum_availabler$krrc[$r)_auto_awq_availablerrr+is_auto_awq_availabler'orrc~[=(a1 [R"[5[R"U5:$r)_auto_round_availablerr_auto_round_versionrs r+is_auto_round_availabler+srrc[$r)_is_optimum_quanto_availablerrr+is_optimum_quanto_availabler.ws ''rc[$r)_quark_availablerrr+is_quark_availabler1|rrc[$r)_compressed_tensors_availablerrr+is_compressed_tensors_availabler4s ((rc[$r)_auto_gptq_availablerrr+is_auto_gptq_availabler7rrc[$r)_gptqmodel_availablerrr+is_gptqmodel_availabler:rrc[$r)_eetq_availablerrr+is_eetq_availabler=rrc[$r)_fbgemm_gpu_availablerrr+is_fbgemm_gpu_availabler@rrc[$r)_levenshtein_availablerrr+is_levenshtein_availablerCrrc2[=(a [S5$)Nzoptimum.neuron)r#r,rrr+is_optimum_neuron_availablerEs  I"78H"IIrc[$r)_safetensors_availablerrr+is_safetensors_availablerHrrc[$r)_tokenizers_availablerrr+is_tokenizers_availablerKrrc[RRS5SLnU(a8[RR S5n[ RSU35 U$![RR aH [RR S5nNZ![RR a gf=ff=f)NPILPillowz Pillow-SIMDFzDetected PIL version )rrrrrr r%r&)_pil_availabler(s r+is_vision_availablerPs^^--e4D@N '0088BO  ,_,=>?  !!66  "+"4"4"<"<]"K%%::   s)A##C B##CC CC c[$r)_pytesseract_availablerrr+is_pytesseract_availablerSrrc[$r)_pytest_availablerrr+is_pytest_availablerVrrc[$r)_spacy_availablerrr+is_spacy_availablerYrrc0[5=(a [$r)rI_tensorflow_text_availablerrr+is_tensorflow_text_availabler\s   ;!;;rc0[5=(a [$r)r\_keras_nlp_availablerrr+is_keras_nlp_availabler_s ' ) B.BBrcS[R;ag[RSRnSU"5R;a [ S5eS[ R ;a"[ R SS:a [ S5e[RRS5SL$![[[4a g f=f) NmarimoTIPython IPKernelAppconsoleDATABRICKS_RUNTIME_VERSIONz11.0 databricksF) sysmodules get_ipythonconfigr#rxryrrrAttributeErrorKeyError)ris r+is_in_notebookrms s{{ "kk),88  4 4 4i( ( '2:: 5"**Ea:bek:kl+ +~~'' 2$>> K 2sB+BB++CCc[$r)_pytorch_quantization_availablerrr+!is_pytorch_quantization_availablerps **rc[$r)!_tensorflow_probability_availablerrr+#is_tensorflow_probability_availablerss ,,rc[$r)_pandas_availablerrr+is_pandas_availablervrrc[R"SS5n[R"U5nUR SS5(dg[ $![R a gf=f)NSM_FRAMEWORK_PARAMS{}*sagemaker_distributed_dataparallel_enabledF)rxgetenvjsonloadsrzJSONDecodeError_smdistributed_available)sagemaker_paramss r+is_sagemaker_dp_enabledrsiyy!6=::&67##$PRWXXY $#   s-AA%$A%cp[R"SS5n[R"U5nSU;ag[R"SS5n[R"U5nUR SS5(dg[ $![Ra gf=f![Ra gf=f)NSM_HP_MP_PARAMETERSry partitionsFrxsagemaker_mpi_enabled)rxr{r|r}r~rzr) smp_options mpi_optionss r+is_sagemaker_mp_enabledrs))148Kjj- { * + ))148Kjj- 6>>? $#      s#B-BBBB54B5c(S[R;$)NSAGEMAKER_JOB_NAME)rxryrrr+is_training_run_on_sagemakerr s 2:: --rc[$r)_soundfile_availablerrr+is_soundfile_availablerrrc[$r)_timm_availablerrr+is_timm_availablerrrc[$r)_natten_availablerrr+is_natten_availablerrrc[$r)_nltk_availablerrr+is_nltk_availablerrrc[$r_torchaudio_availablerrr+is_torchaudio_availabler!rrc~[=(a1 [R"[5[R"U5:$r)_torchao_availablerr_torchao_versionrs r+is_torchao_availabler%s&  _'--0@"AW]]S^E_"__rc[$rrrrr+is_speech_availabler)s  rc[$r)_spqr_availablerrr+is_spqr_availabler.rrc[$r)_phonemizer_availablerrr+is_phonemizer_availabler2rrc[$r)_uroman_availablerrr+is_uroman_availabler6rrc^U4SjnU$)Nc@>[(d [S5eT"U0UD6$)Nz|You need to install pytorch to use this method or class, or activate it with environment variables USE_TORCH=1 and USE_TF=0.)rr#)argskwargsfns r+wrapper"torch_only_method..wrapper;s.V  t&v& &rr)rrs` r+torch_only_methodr:s' Nrc[$r)_is_ccl_availablerrr+is_ccl_availablerGrrc[$r)_sudachipy_availablerrr+is_sudachi_availablerKrrc[$r)_sudachipy_versionrrr+get_sudachi_versionrOrrc[5(dg[R"[5[R"S5:$)NFz0.6.8)rrrrrrr+is_sudachi_projection_availablerSs.  ! ! ==+ , g0F FFrc[RRS5SL=(a [R"S5SL$)Nrhoknpjumanpp)rrrshutilwhichrrr+is_jumanpp_availabler\s0 NN $ $X .d : eiAX`dAdercD[RRS5SL$)N pyximportrrrr+is_cython_availabler`s >> # #K 0 <= {ACCELERATE_MIN_VERSION} it was not found in your environment. You can install or update it with pip: `pip install --upgrade accelerate`. Please note that you may need to restart your runtime after installation. a {0} requires the torch ccl library but it was not found in your environment. You can install it with pip: `pip install oneccl_bind_pt -f https://developer.intel.com/ipex-whl-stable` Please note that you may need to restart your runtime after installation. z {0} requires essentia library. But that was not found in your environment. You can install them with pip: `pip install essentia==2.1b6.dev1034` Please note that you may need to restart your runtime after installation. z {0} requires the librosa library. But that was not found in your environment. You can install them with pip: `pip install librosa` Please note that you may need to restart your runtime after installation. z {0} requires the pretty_midi library. But that was not found in your environment. You can install them with pip: `pip install pretty_midi` Please note that you may need to restart your runtime after installation. z {0} requires the Cython library but it was not found in your environment. You can install it with pip: `pip install Cython`. Please note that you may need to restart your runtime after installation. z {0} requires the jieba library but it was not found in your environment. You can install it with pip: `pip install jieba`. Please note that you may need to restart your runtime after installation. z {0} requires the peft library but it was not found in your environment. You can install it with pip: `pip install peft`. Please note that you may need to restart your runtime after installation. z {0} requires the jinja library but it was not found in your environment. You can install it with pip: `pip install jinja2`. Please note that you may need to restart your runtime after installation. z {0} requires the rich library but it was not found in your environment. You can install it with pip: `pip install rich`. Please note that you may need to restart your runtime after installation. levenshteinprotobufspeechtfvisioncythonjinjac[U[[45(dU/n[US5(a UROUR RnSU;aBSU;a<[ 5(d-[5(a[[RU55eSU;aBSU;a<[ 5(a-[5(d[[RU55e/nUHin[U[5(aURURpeO [UupVU"5(aMIUR!URU55 Mk U(a[SR#U55eg)N__name__rr) isinstancelisttuplerr __class__rrIr#PYTORCH_IMPORT_ERROR_WITH_TFformatTF_IMPORT_ERROR_WITH_PYTORCHBackend is_satisfied error_messageBACKENDS_MAPPINGappendjoin)objr namefailedbackendrmsgs r+requires_backendsr6s# hu . .:"3 333<<9O9OD(t83URS5(aUS:wdUS:Xd US:XdUS:Xa[TU] U5$[XR5 g)Nr. _from_configis_dummymrocall) startswithsuper__getattribute__r _backends)clskeyrs r+r DummyObject.__getattribute__ZsN NN3  C>$9cZ>OSVZ_S_cfjpcp7+C0 0#}}-rr) r __module__ __qualname____firstlineno____doc__rr __static_attributes__ __classcell__rs@r+rrRs H..rrch[5(a#SSKn[XRR5$gr)r@torch.fxrfxProxy)r-rs r+is_torch_fx_proxyr`s$!XX^^,, rc^\rSrSrSrSS\S\S\S\\RRS\\ \\ 4S\\ \\ \44 U4S jjjrU4S jrS\S \4S jrS \4SjrSrSrU=r$) _LazyModuleilzm Module class that surfaces all objects but only performs associated imports when the objects are requested. r module_fileimport_structure module_spec extra_objectsexplicit_import_shortcutc>^[TU]U5 0UlU(aUO0Ul[ SUR 555(Gaj[ 5Ul0Ul/Ul 0nUR5GHup/n [ [[U R 55V V s/sHCn [U RS5S-5V s/sHoRSU 5SPM sn PME sn n 65n UHymT[ ;a [ TupO@[ U4SjS55(a[#T5mTR$nO['ST35eU"5(dU R)T5 MyM{ URR5U 5UlU R5H}unn[7U 5(aXRU'UH2nUURU'[7U 5(dM$XRU'M4 UR9U/5R;U5 M URR;U [ [U R=565-5 GM X lX@l [BRDRGU5/Ul$Uc0OUUl%Xl&Xpl'g[ UR 55Ul0UlUR5HunnUHnUURU'M M [UR 55[[UR=565-Ul X lX@l [BRDRGU5/Ul$Uc0OUUl%Xl&X0l'gs sn fs sn n f![*R,R.[0[24a U R)T5 GMf=f)Nc3B# UHn[U[5v M g7frr frozenset).0r s r+ '_LazyModule.__init__..sM5Lcz#y))5Lrrrc3,># UH oT;v M g7frrr%r rs r+r&r'sI#g~=<>FBackend should be defined in the BACKENDS_MAPPING. Offending backend: )(r__init___object_missing_backend_explicit_import_shortcutanykeysr_modules_class_to_module__all__itemsrrrangecountrsplitrrrrrrrr ModuleNotFoundErrorrtunionlen setdefaultextendvalues__file____spec__rxpathdirname__path___objects_name_import_structure)rrrrrrr rJr modulemissing_backendski module_keyscallabler.r rBrrrs @r+r1_LazyModule.__init__ss` ')$E])Ace& M5E5J5J5LM M MEDM$&D !DL " $4$:$:$< #% ""\`agalalan\op\oWX% q@P:QR:QQXXc1-a0:QR\opq  (G"22&6w&? !IIII&-g&6G'.';';H","hiphq r#9'zz,33G< * ($!% 3 3K @ #)<<>KC+,,[TU]5nURHnX!;dM URU5 M U$r)r__dir__r8r)rresultattrrs r+rS_LazyModule.__dir__s8"LLD! d#! rrc^ XR;aURU$XRR5;amURUm "U 4SjS[S9nXlXR ;aSU3nO*UR UnUR S5(dSU3nX2lUnOXR R5;a+URUR U5n[XQ5nO}XR;aURU5nO[SnURR5HupxX;dM URU5nM Uc[SURSU35e[!XU5 U$![[4an[SUS35UeSnAff=f![[4an[SUS35UeSnAff=f) Nc.>\rSrSrYrU4SjrSrSrg),_LazyModule.__getattr__..Placeholderic>[UT5 gr)r)rrrrLs r+r15_LazyModule.__getattr__..Placeholder.__init__s%d,<=rcgrr)rrrs r+r1_LazyModule.__getattr__..Placeholder.callsrrN)rrrrr r1rr)rLsr+ PlaceholderrYs, >rr^) metaclass transformers.zCould not import module 'z4'. Are this object's requirements defined correctly?zmodule z has no attribute )rHr2r5rrr7rr _get_moduler"r=rtr6r3r9rksetattr) rrr^ module_namerrKer rBrLs @r+ __getattr___LazyModule.__getattr__s == ==& & //446 6#;;DA    $( 000 -dV4 "33D9 "--o>>$1+"?K%0 "E **//1 1 ))$*?*?*EF- ]] " ((. E#==CCE > ,,S1E F}$wt}}o=OPTv%VWWE" -(6 )/v5ij (6 )/v5ij s0)E=F%=F" FF"%G 5GG rcc [R"SU-UR5$![a$n[ SURSUSU35UeSnAff=f)NrzFailed to import z@ because of the following error (look up to see its traceback): )rr!rr$rt)rrcrds r+ra_LazyModule._get_modulesf **3+> 1 1$^b]c 1 dD ^^ , ,T 2FKKF# [[ F Mrc\rSrSr\R r\Rr\Rr \Rr \Rr\Rr\S\SS4Sj5rSrg)VersionComparisoni;version_stringrcn[RR[RR[RR[RR[R R[R R[RRS.nX$)N)r-z==z!=r/r.z>=z<=)rEQUALr NOT_EQUAL GREATER_THAN LESS_THANGREATER_THAN_OR_EQUALLESS_THAN_OR_EQUAL)rstring_to_operators r+ from_stringVersionComparison.from_stringCs#((..#))//#--33"//55",,22#99??#66<< "11rrN)rrrroperatoreqrnergtrltrgerler staticmethodr{rrrrr+rr;s[ KKE I;;L I$KK! 2C 2,? 2 2rrcSn[R"X5nU(a2URS5URS5URS54$[SU35e)Nz#([a-zA-Z0-9_-]+)([!<>=~]+)([0-9.]+)rr r$z Invalid package version string: )rematchgroupr)package_version_strpatternrs r+split_package_versionrRsR4G HHW 2E  A A A??;"$"3"3!44EdF]F]E^_c_k_k^lmL M r)rrrN) rrrrr{r1boolrrpropertyrrrrr+rr\s<C d q#q  rrr)r c*^^[U[5(d [S5e/mUHbmT[;aTR T5 M [ U4SjS55(aTR [ T55 MV[ST35e U4SjnU$)z This decorator enables two things: - Attaching a `__backends` tuple to an object to see what are the necessary backends for it to execute correctly without instantiating it - The '@requires' string is used to dynamically import objects zBackends should be a tuple.c3,># UH oT;v M g7frrr*s r+r&requires..s=_c'>_r+r,r0c>TUlU$r) __backends)funapplied_backendss r+inner_fnrequires..inner_fns) r)rrrrrr4r)r rrrs @@r+requiresrus h & &677 & &  # #G ,=_=== ''(89 #ijqir!stt Orc SU;$)N modeling_tf_rrds r+rs n!r)rc SU;$)Nmodeling_flax_rrs r+rrs !#r)rc SU;$)N modeling_rrs r+rrs kQrrcTURS5=(a URS5$)N tokenization__fastrendswithrs r+rrsall?+C 70CCr)r|cTURS5=(a URS5$)Nimage_processing_rrrs r+rrsall./GAJJw4GGr)rrrc$URS5$)Nr)rrs r+rrsall./r)rcSU;a/$SnUR5n[U5Hup4URS5(dMUnM! Uc/$X!SnUSRS5(d [S5eUSR S5(aTUSR S5SR S5R S 5Vs/sHoUR S 5PM sn$/n[S[U55H?nX'R 5S:XaUs $URX'R S 55 MA U$s snf) z Returns the content of the __all__ variable in the file content. Returns None if not defined, otherwise returns a list of strings. r8Nrz`fetch__all__ accepts a list of lines, with the first line being the __all__ variable declaration]r-rz [],z"' z"', ) splitlines enumeraterrrrstripr:r?r) file_content start_indexlinesindexliner_all__all__line_indexs r+ fetch__all__rs@  $ K  # # %E '  ??9 % %K(  , E 8  y ) ) n   Qx-21X^^C-@-C-I-I%-P-V-VWZ-[\-[c &!-[\\!&q#e*!5 '--/36  E4::7CD "6  ]sD?c Z 0n[RRU5(a[RRU5nUn/n[R"U5HnUS:wam[RR [RR X55(a,[[RR X55X'Mv[RR [RR X$55(aMURU5 M SU;aURS5 SnU"SU5(a(U"SU5(aUVs/sH nSU;dM UPM nn0nUGHnURS5(dM[[RR X(5SS9nUR5n S S S 5 US S nS n S n S n [R5HupU "U5(dMUn O [5nSW ;GatU R!S5n[#U5GHSunnUR%S5(aUR%S5(dM5SnSU ;GaSnSU ;aU R!S5SR!S5SR!S5S n['[)UR!S5Vs/sHnU(dM UR+S5PM sn55nOSUU S-;a/nUU UHnSU;aUR!S5SnSU;dSU;aNSU;a(UR-SUR!S555 O URUR+S55 UR+5S:XdM O ['U5nOS n[/UU -5nUU;a0UU'XU;a[5UUU'UR%S5(dUR%S5(dS nOhUR%S5(aS!OS"nUUS R!S5S R+S#5nUUUR1U5 UR1U5 U(aGMOUn Un GMV S$U ;dGM#[3U 5HPnUU;dM [/U 5nUU;a0UU'XU;a[5UUU'UUUR1U5 MR GM 0UEUEnU$s snf!,(df  GNG=fs snf)%aL This method takes the path to a file/a folder and returns the import structure. If a file is given, it will return the import structure of the parent folder. Import structures are designed to be digestible by `_LazyModule` objects. They are created from the __all__ definitions in each files as well as the `@require` decorators above methods and objects. The import structure allows explicit display of the required backends for a given object. These backends are specified in two ways: 1. Through their `@require`, if they are exported with that decorator. This `@require` decorator accepts a `backend` tuple kwarg mentioning which backends are required to run this object. 2. If an object is defined in a file with "default" backends, it will have, at a minimum, this backend specified. The default backends are defined according to the filename: - If a file is named like `modeling_*.py`, it will have a `torch` backend - If a file is named like `modeling_tf_*.py`, it will have a `tf` backend - If a file is named like `modeling_flax_*.py`, it will have a `flax` backend - If a file is named like `tokenization_*_fast.py`, it will have a `tokenizers` backend - If a file is named like `image_processing*_fast.py`, it will have a `torchvision` + `torch` backend Backends serve the purpose of displaying a clear error message to the user in case the backends are not installed. Should an object be imported without its required backends being in the environment, any attempt to use the object will raise an error mentioning which backend(s) should be added to the environment in order to use that object. Here's an example of an input import structure at the src.transformers.models level: { 'albert': { frozenset(): { 'configuration_albert': {'AlbertConfig', 'AlbertOnnxConfig'} }, frozenset({'tokenizers'}): { 'tokenization_albert_fast': {'AlbertTokenizerFast'} }, }, 'align': { frozenset(): { 'configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'processing_align': {'AlignProcessor'} }, }, 'altclip': { frozenset(): { 'configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'processing_altclip': {'AltCLIPProcessor'}, } } } __pycache__ __init__.pyc.^[U4SjU55$)Nc3.># UH nTU;v M g7frr)r%r- substrings r+r&Lcreate_import_structure_from_path..find_substring.. s15a9>5s)r4)rlist_s` r+find_substring9create_import_structure_from_path..find_substring s15111rmodular_rz.pyzutf-8)encodingNrrrz @requires )  @)Fr z backends=r(rz, z'",r-"'c3B# UHoRS5v M g7f)()"', N)r)r%rs r+r&4create_import_structure_from_path.._ s3u\tQXMM)4L4L\tr(rclassdefTrr%:r8)rxrEisfilerFlistdirisdirr!create_import_structure_from_pathrremoveropenreadBASE_FILE_REQUIREMENTSr9rrrrrsortedrrAr$addr) module_pathr directoryadjacent_modulesfrrKmodule_requirementsrcr previous_lineprevious_indexbase_requirements string_check requirementsexported_objectsrrr skip_linebackends_stringbr  backend_liner object_name _all_objects r+rrsn ww~~k""ggook2 I ZZ $ "''-- [0L"M"M"CBGGLLQ\D`"a  rww||I9::  # #A & %(( .2j"233{Td8e8e1A^1AvZW]E]F1A^' ##E**  "'',,y6 IQ668LJ"#2&   *@*F*F*H &LK(($0!+I5 , & &&t,E(/ t??#899$//R]B^B^ " -/ %I"]2*7*=*=k*J1*M*S*STW*XYZ*[*a*abe*fgh*i#(/J_J_`dJe0kJeQijJe0k)l#m$$u^a-?'@@#%,1.,GL)\9/;/A/A#/Fq/I "l2c\6I#'<#7$,OO3u\h\n\nos\t3u$u$,OOL4F4Fy4Q$R ,113s: %-H$)?$&(4E)EFH'::8:+H5"h*GGEHU+H5kB??733DOOE&>s&CA&F&L&LS&Q +H5kBFF{S(,,[9 y$(M%*NO 0V  $+L9 &66():;H'::8:+H5"h*GGEHU+H5kB'1+>BB;O :Q(dC-B1AB m_J IP1ls$( T6TT T(.T( T% c^^U4SjmSU4SjjmUn[S5H nT"U5nM 0nUR5R5H(upE[U[5(aX MT"U5X4'M* U$)a This method takes as input an unordered import structure and brings the required backends at the top-level, aggregating modules and objects under their required backends. Here's an example of an input import structure at the src.transformers.models level: { 'albert': { frozenset(): { 'configuration_albert': {'AlbertConfig', 'AlbertOnnxConfig'} }, frozenset({'tokenizers'}): { 'tokenization_albert_fast': {'AlbertTokenizerFast'} }, }, 'align': { frozenset(): { 'configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'processing_align': {'AlignProcessor'} }, }, 'altclip': { frozenset(): { 'configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'processing_altclip': {'AltCLIPProcessor'}, } } } Here's an example of an output import structure at the src.transformers.models level: { frozenset({'tokenizers'}): { 'albert.tokenization_albert_fast': {'AlbertTokenizerFast'} }, frozenset(): { 'albert.configuration_albert': {'AlbertConfig', 'AlbertOnnxConfig'}, 'align.processing_align': {'AlignProcessor'}, 'align.configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'altclip.configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'altclip.processing_altclip': {'AltCLIPProcessor'} } } c>0nUR5GHFup#[U[5(dX1U'M![SUR 555(aUR5HupE[U[ 5(a0XA;a0X'X!U;a0XU'XUR U5 MJT "XE05nUR5Hxupx[U[ 5(a0Xq;a0X'X!U;a0XU'XUR U5 MJX!;a0X'XqU;a0XU'XUR U5 Mz M GM<T "U5X'GMI U$)Nc3B# UHn[U[5v M g7frr#)r%vs r+r&Gspread_import_structure..propagate_frozenset.. sE}!Z9--}r()r9rdictr4r5r$update) unordered_import_structure frozenset_first_import_structure_key_valuerMr propagated_frozensetr_kr_vpropagate_frozensets r+r4spread_import_structure..propagate_frozenset s{+-(6<<>LDfd++9?6Ev{{}EEE"LLNDA!!Y//DBD<?'JJHJ<?E8;DAHHK0CA6/J,(<(B(B(DHC)$ ::#&#NLN$D$I#'PS/T#TRT$D$I$$O!A Ed K R RSV W#'#OMO$D$J#&t.T#TRT$D$J3$O!A Fs K R RSV W!)E%+J:MV9T06W?Z0/rc>/nUR5H_up4UbUSU3OUn[U[5(a'URT"XC5R55 MMUR X445 Ma [U5$r)r9rr rAr)_dict previous_keyr9rr flatten_dicts r+r-spread_import_structure..flatten_dict sr!KKMLD/;/Gl^1TF+TD&$'' \&7==?@ d^, * E{rrr)r:copyr9rr{)nested_import_structureordered_import_structurerNflattened_import_structurer rrrs @@r+spread_import_structurer  s^/0b 71X#67O#P "$.335;;=  c3  (-.:5.A & + > &%rrprefixc[U5n[U5nUcU$UR5VVVVs0sH0upEXER5VVs0sH upgUSU3U_M snn_M2 nnnnnU$s snnfs snnnnf)a This method takes a module_path as input and creates an import structure digestible by a _LazyModule. Here's an example of an output import structure at the src.transformers.models level: { frozenset({'tokenizers'}): { 'albert.tokenization_albert_fast': {'AlbertTokenizerFast'} }, frozenset(): { 'albert.configuration_albert': {'AlbertConfig', 'AlbertOnnxConfig'}, 'align.processing_align': {'AlignProcessor'}, 'align.configuration_align': {'AlignConfig', 'AlignTextConfig', 'AlignVisionConfig'}, 'altclip.configuration_altclip': {'AltCLIPConfig', 'AltCLIPTextConfig', 'AltCLIPVisionConfig'}, 'altclip.processing_altclip': {'AltCLIPProcessor'} } } The import structure is a dict defined with frozensets as keys, and dicts of strings to sets of objects. If `prefix` is not None, it will add that prefix to all keys in the returned dict. r)rr r9)rr!r spread_dictrMr kkvvs r+define_import_structurer& s09E)*:;K ~U`UfUfUhiUhTQqggiHiFBfXQrd+R/iHHUh iIisA5 A/ A5 /A5 c[RVs/sHoRS5(dMUPM nnUHCn[RUn[U[5(a0Ul[RU ME S[R;aF[RSn[U[5(a0Ul[ R"U5 ggs snf)z Clear cached Transformers modules to allow reloading modified code. This is useful when actively developing/modifying Transformers code. r`rtN)rgrhrrrrHrreload)mod_nametransformers_modulesrK main_modules r+clear_import_cacher,/ s69[[i[DWDWXgDhH[i)X& fk * * FO KK ! )$kk.1 k; / /#%K % %js CC)Fr)FF)T)r)r(rimportlib.machineryrimportlib.metadataimportlib.utilr|rrxrrrrgr collectionsrenumr functoolsr itertoolsrtypesrtypingrr r r r r rr packagingrrr get_loggerrr%r{rr,ENV_VARS_TRUE_VALUESr>ENV_VARS_TRUE_AND_AUTO_VALUESryrzupperr2r3USE_JAXr5r6rTORCH_FX_REQUIRED_VERSIONACCELERATE_MIN_VERSIONSCHEDULEFREE_MIN_VERSIONFSDP_MIN_VERSIONGGUF_MIN_VERSIONXLA_FSDPV2_MIN_VERSIONHQQ_MIN_VERSIONVPTQ_MIN_VERSIONTORCHAO_MIN_VERSIONAUTOROUND_MIN_VERSIONrrrrrrrrrrrrr<r?rrrrrrErLrrrrr r_faiss_versionr&r r^rarrrrrrr^rBrrrrRrUr#r6r9r)r*r&r0r-r3rurBrrrrrrrRrUrorrrGrrrrrrrrrXrrrrr[rOrrJrrrrrrrrrrrrrrrrrrrrinfo _tf_versionrH candidatespkgr_essentia_versionr_pretty_midi_version ccl_versionrrX _flax_version_jax_available _jax_versionrg_torch_xla_versionrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrrr4r8r>r@rCrFrIrMrPrSrVrYr\r_rbrlrprrrrr'rrrrrrrrrrrrrrrrrrrrrrrrrrr r rrrrrrr!r$r'r+r.r1r4r7r:r=r@rCrErHrKrPrSrVrYr\r_rmrprsrvrrrrrrrrrrrrrrrrrrrrrrrrrrrrrAV_IMPORT_ERRORYT_DLP_IMPORT_ERRORDECORD_IMPORT_ERRORCV2_IMPORT_ERRORDATASETS_IMPORT_ERRORTOKENIZERS_IMPORT_ERRORSENTENCEPIECE_IMPORT_ERRORPROTOBUF_IMPORT_ERRORFAISS_IMPORT_ERRORPYTORCH_IMPORT_ERRORTORCHVISION_IMPORT_ERRORrrBS4_IMPORT_ERRORSKLEARN_IMPORT_ERRORTENSORFLOW_IMPORT_ERRORDETECTRON2_IMPORT_ERRORFLAX_IMPORT_ERRORFTFY_IMPORT_ERRORLEVENSHTEIN_IMPORT_ERRORG2P_EN_IMPORT_ERROR!PYTORCH_QUANTIZATION_IMPORT_ERROR#TENSORFLOW_PROBABILITY_IMPORT_ERRORTENSORFLOW_TEXT_IMPORT_ERRORTORCHAUDIO_IMPORT_ERRORPANDAS_IMPORT_ERRORPHONEMIZER_IMPORT_ERRORUROMAN_IMPORT_ERRORSACREMOSES_IMPORT_ERRORSCIPY_IMPORT_ERRORKERAS_NLP_IMPORT_ERRORSPEECH_IMPORT_ERRORTIMM_IMPORT_ERRORNATTEN_IMPORT_ERRORNUMEXPR_IMPORT_ERRORNLTK_IMPORT_ERRORVISION_IMPORT_ERRORPYTESSERACT_IMPORT_ERRORPYCTCDECODE_IMPORT_ERRORACCELERATE_IMPORT_ERRORCCL_IMPORT_ERRORESSENTIA_IMPORT_ERRORLIBROSA_IMPORT_ERRORPRETTY_MIDI_IMPORT_ERRORCYTHON_IMPORT_ERRORJIEBA_IMPORT_ERRORPEFT_IMPORT_ERRORJINJA_IMPORT_ERRORRICH_IMPORT_ERRORrrtyperr BACKENDS_Trmr BaseExceptionrrr}rrrrrrrr r&r,rrr+rs   #JJJ   H %)C))%PUVZ\_V_P`bfPfJg)X2 4 : :F8 D & ) / / 1 JJNN; / 5 5 7 **..V , 2 2 4 4::< ZZ^^$8&AGGI$MM&1!" -B<`d-e**'//?'/!6vd!S((.d: NN,,X6dB/?'/-l;/?' 5,[91F~fj1k..))%0<.}=))%0<NN,,X6dB+J7-l;>>++G4D@ %''//8N LL77GHI(/)(3+,EF!67Tei!j(1(2(1,[9.}=*95)(3'/'/)(3*95,[9,[9-B<`d-e**nn..u5TA(1$) /0#' !* 8 89M NVZ Z)(3'/-l;)(3)(3*95.}=+J7.}=)(3"78N"O)(3-l;.}=(10A+G4$9&QU$V!M^^--i8D#"">2%>>33ODDP,[9(1+@]a+b(($9:R$S!23DE*95'/-l;-l;'dJ  JK!"+"4"4"<"> 8 Eop!&  CD nn..z:$F!**22:> LL:;L:MNO #11-@L#$--55mD LL=>R=STU   NN[)5K~~ =>dJ$$,,-=>K LL3K=AB  ++%:6RV%W"O]'  .  "  (    > >$  0 @ @, , ,^ J J  &"E !!*:Z3Z 3( > >8    >>0 ] ] eCe e dsdd d"  n n$ n  n!$*:]3]C *:`3`0Eff( )  !"J"!    "<C(+- $$0. !-@`c`! !  Gf= 7_ $       %!'#                 / 12/ !#345/ !#345/ +-BCD / ')<=> / /1HIJ / +-BCD/ %'9:;/ #%678/ #%678/ ')<=>/ ')<=>/ /1HIJ/ ')<=>/ 13KLM/ 13KLM!/" )+?@A#/$ +-BCD%/& 13KLM'/( 13KLM)/* /1HIJ+/, "CEf!gh-/. 57QRS//0 )+?@A1/2 ')<=>3/4 "$GIl#mn5/6 !89:7/8 9;WXY9/: #%678;/< /1HIJ=/> ')<=>?/@ #%678A/B /1HIJC/D %';<=E/F 13KLMG/H ')<=>I/J %'9:;K/L /1HIJM/N ,.>?@O/P ')<=>Q/R %'9:;S/T #%678U/V %'9:;W/X ')<=>Y/Z #%678[/\ -/EFG]/1h+8 .$ .s^ *d3C=&99:uU*uUp[][S&22. S%S# 2FS S  2:"7#Y C_GIk/ 'T F FR{&| hsmOa B&CM.. %%"++33K@ ;N;KLM    2 2% %&//77 DN LL??OP Q Q!!66 %$  % % %F..)#( )4    2 2#"#J!))>>"....#"#..s/z1;}9,~~?3/!/A@3/A@'1}6 /{>>}2/} }6 }.(}2)}6-}..}22}69~~~<;~<?!A@@A@@A@$@#A@$@'AAAAA