7ThY%SSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK J r SSK J r SSK Jr SSKJrJrJrJrJrJrJrJr SSKJr \(aSSKrSSKJr SS KJr S r\"S 5r S'S(S jjr!S'S)S jjr"0r#S\$S'S*Sjr%S+Sjr&S,Sjr'S-S.Sjjr(S/Sjr)S0Sjr*S1Sjr+S2Sjr,S3S4Sjjr-S5Sjr.S6Sjr/S7Sjr0S8Sjr1S9Sjr2S:S;Sjjr3SS!j5r7S?S@S"jjr8SAS#jr9\RlSBSCS$jj5r:S%r;S&r>> infer_storage_options('/mnt/datasets/test.csv') # doctest: +SKIP {"protocol": "file", "path", "/mnt/datasets/test.csv"} >>> infer_storage_options( ... 'hdfs://username:pwd@node:123/mnt/datasets/test.csv?q=1', ... inherit_storage_options={'extra': 'value'}, ... ) # doctest: +SKIP {"protocol": "hdfs", "username": "username", "password": "pwd", "host": "node", "port": 123, "path": "/mnt/datasets/test.csv", "url_query": "q=1", "extra": "value"} z^[a-zA-Z]:[\\/]z^[a-zA-Z0-9]+://file)protocolpath#z^/([a-zA-Z])[:|]([\\/].*)$:)httphttps@rhost)s3s3agcsgsrportusernamepassword url_query url_fragment)rematchrschemefragmentjoinrgroupsnetlocrsplitr#r$r%queryupdate_storage_options)urlpathinherit_storage_options parsed_pathrr windows_pathdriveoptionss D/var/www/auris/envauris/lib/python3.13/site-packages/fsspec/utils.pyinfer_storage_optionsr9&s@ #W-- 88' 1 9"G447#K!!+VHxx));+?+?@A6xx =tD &--/KEWAdV$D$$$66+3BG&,,33C;B?FFsANqQ 1 1%fo?GFO%foGFO   )..GFO   "-"6"6GJ    "-"6"6GJ *00 "-"6"6w@ NcU(d0n[U5[U5-nU(a;UH5nURU5URU5:wdM)[SU35e URU5 g)Nz9Collision between inferred and specified storage option: )setgetKeyErrorupdate)r7 inherited collisions collisions r8r1r1{so  WI.J#I{{9%y)AA ){,$  NN9r:zdict[str, str] compressionsc[RRU5SRS5R 5nU[ ;a [ U$g)a Infer compression, if available, from filename. Infer a named compression type, if registered and available, from filename extension. This includes builtin (gz, bz2, zip) compressions, as well as optional compressions. See fsspec.compression.register_compression. r.N)osrsplitextstriplowerrC)filename extensions r8infer_compressionrLsG  *2.44S9??AIL I&& r:c^US- n[[R"[R"U555mSU4SjjnU$)aUReturns a function that receives a single integer and returns it as a string padded by enough zero characters to align with maximum possible integer >>> name_f = build_name_function(57) >>> name_f(7) '07' >>> name_f(31) '31' >>> build_name_function(1000)(42) '0042' >>> build_name_function(999)(42) '042' >>> build_name_function(0)(0) '0' g:0yE>c8>[U5RT5$N)strzfill)i pad_lengths r8 name_function*build_name_function..name_functions1v||J''r:)rRintreturnrP)rVmathceillog10)max_intrTrSs @r8build_name_functionr\s7& tOGTYYtzz'234J( r:cUR5S:XagSnURU5nU(dgU(aX4-OUnX;aLURU5nURUR5[ U5U- - [ U5-5 g[ U5U:agU[ U5*SnM![ [ 4a N#f=f)a\Seek current file to file start, file end, or byte after delimiter seq. Seeks file to next chunk delimiter, where chunks are defined on file start, a delimiting sequence, and file end. Use file.tell() to see location afterwards. Note that file start is a valid split, so must be at offset > 0 to seek for delimiter. Parameters ---------- file: a file delimiter: bytes a delimiter like ``b'\n'`` or message sentinel, matching file .read() type blocksize: int Number of bytes to read from the file at once. Returns ------- Returns True if a delimiter was found, False if at file start or end. rFNT)tellreadindexseeklenOSError ValueError)r delimiter blocksizelastcurrentfullrRs r8seek_delimiterrjs. yy{aD ))I&!%t~7  JJy) $))+TQ7#i.HIW )* S^O%&! $   sAB3B33CCcU(aURU5 [XS5nUcUR5$UR5nX&U- -nURXb-5 [XS5nUR5nU(aU(aU[ U5-nU(aU(aU[ U5-nUnX- nURU5 UceURU5n U $)aRead a block of bytes from a file Parameters ---------- f: File Open file offset: int Byte offset to start read length: int Number of bytes to read, read through end of file if None delimiter: bytes (optional) Ensure reading starts and stops at delimiter bytestring split_before: bool (optional) Start/stop read *before* delimiter bytestring. If using the ``delimiter=`` keyword argument we ensure that the read starts and stops at delimiter boundaries that follow the locations ``offset`` and ``offset + length``. If ``offset`` is zero then we start at zero, regardless of delimiter. The bytestring returned WILL include the terminating delimiter string. Examples -------- >>> from io import BytesIO # doctest: +SKIP >>> f = BytesIO(b'Alice, 100\nBob, 200\nCharlie, 300') # doctest: +SKIP >>> read_block(f, 0, 13) # doctest: +SKIP b'Alice, 100\nBo' >>> read_block(f, 0, 13, delimiter=b'\n') # doctest: +SKIP b'Alice, 100\nBob, 200\n' >>> read_block(f, 10, 10, delimiter=b'\n') # doctest: +SKIP b'Bob, 200\nCharlie, 300' i)rarjr_r^rb) foffsetlengthre split_beforefound_start_delimstartfound_end_delimendbs r8 read_blockrusV v*1? >668O&.  u~(u=ffh  S^ #E | 3y> !CFF6N    vA Hr:cU(aX4- n[[U5R55nUR 5$![a3 [[U5R5SS9nUR 5$f=f)zDeterministic token (modified from dask.base) >>> tokenize([1, 2, '3']) '9d71491b50023b06fc76928e6eddb952' >>> tokenize('Hello') == tokenize('Hello') True F)usedforsecurity)rrPencoderd hexdigest)argskwargshs r8tokenizer}4sq ; D   " # ;;= ; D   "E : ;;=;s"A+A=<A=c[U[5(aU$[US5(aUR5$[US5(a UR$U$)aAttempt to convert a path-like object to a string. Parameters ---------- filepath: object to be converted Returns ------- filepath_str: maybe a string version of the object Notes ----- Objects supporting the fspath protocol are coerced according to its __fspath__ method. For backwards compatibility with older Python version, pathlib.Path objects are specially coerced. Any other object is passed through unchanged, which includes bytes, strings, buffers, or anything else that's not even path-like. __fspath__r) isinstancerPhasattrrr)filepaths r8stringify_pathrIsN,(C   < ( (""$$ 6 " "}}r:c6U"U0UD6nUR5 U$rO)_determine_worker)clsrzr{insts r8 make_instanceris$   D Kr:c^^UVs/sHoRS5PM snm[ST55nSn[U5H"m[UU4SjT55nU(aM" O TU- mSR TSST5$s snf)z;For a list of paths, find the shortest prefix common to all/c38# UHn[U5v M g7frO)rb).0ps r8 common_prefix..ts%u!s1vvurc3>># UHoTTST:Hv M g7f)rN)rrrRpartss r8rrws 5u!A$%(1+%usN)splitminrangeallr,)pathsrlmaxrsrRrs @@r8 common_prefixrqs#( )5aWWS\5 )E %u% %D C 4[5u55s HA 88E!HRaL !! *sBc 8[U[5(aURS5nU(a6UVs/sH'nSRXR S5S45PM) nnU$[ U5nU(aUR SS5SnU(d;[SU55(a$UVs/sHnSRX/5PM nnU$UVs/sHoDRXQS5PM nnU$[U5[U5:XdeU$s snfs snfs snf)aEIn bulk file operations, construct a new file tree from a list of files Parameters ---------- paths: list of str The input file tree path2: str or list of str Root to construct the new list in. If this is already a list of str, we just assert it has the right number of elements. exists: bool (optional) For a str destination, it is already exists (and is a dir), files should end up inside. flatten: bool (optional) Whether to flatten the input directory tree structure so that the output files are in the same directory. Returns ------- list of str rrrrc3L# UHoRS5(+v M g7f)rN) startswithrss r8rother_paths..sCU,,s"333Us"$) rrPrstripr,rrr/rreplacerb)rpath2existsflattenrcps r8 other_pathsr~s6% S! BGH%QSXXuggcl2&678%EH Lu%BYYsA&q)#CUCCC7<=u!5*-u= L;@@%Q2a0%@ L5zSZ''' LI >@s.D -DDc"[U[5$rO)r BaseExceptionobjs r8 is_exceptionrs c= ))r:c.^[U4SjS55$)Nc3<># UHn[TU5v M g7frO)r)rattrrls r8risfilelike..sF,EDwq$,Es)r_closer^)r)rls`r8 isfilelikers F,EF FFr:cn[U5n[R"SUSS9n[U5S:aUS$g)Nz (\:\:|\://)r)maxsplitrr)rr(rrb)urlrs r8 get_protocolrs5  C HH^S1 5E 5zA~Qx r:ctSSKJn [U"[U55SS5$![[ 4a gf=f)z*Can the given URL be used with open_local?r)get_filesystem_class local_fileF)fsspecrgetattrrrd ImportError)rrs r8 can_be_localrs;++L,>?uUU  $s $77c U[R;a0[RUn[US5(a UR$[ U5$! O=fSSKnUR U5nUR$![[4a gf=f)zFor given package name, try to find the version without importing it Import and package.__version__ is still the backup here, so an import *might* happen. Returns either the version string, or None if the package or the version was not readily found. __version__rN) sysmodulesrrr importlib import_modulerAttributeError)namemodrs r8"get_package_version_without_importrs s{{kk$ 3 & &?? " t}  %%d+  (s AA A::B  B cdUcUc [S5eU=(d [R"U5n[R"5n[R"S5nUR U5 U(aUR R5 URU5 URU5 U$)Nz+Provide either logger object or logger namezD%(asctime)s - %(name)s - %(levelname)s - %(funcName)s -- %(message)s) rdlogging getLogger StreamHandler Formatter setFormatterhandlersclear addHandlersetLevel)logger logger_namelevelrhandle formatters r8 setup_loggingrs ~+-FGG  5w((5F  " " $F!!NI  "  f OOE Mr:c$URU5$rO)unstrip_protocol)rfss r8_unstrip_protocolrs  t $$r:c.^^^SU4SjjmSUU4SjjnU$)ziMirror attributes and methods from the given origin_name attribute of the instance to the decorated classc2>[UT5n[X 5$rO)r)methodselforigin origin_names r8 origin_getter"mirror_from..origin_getters{+v&&r:c\>TH$n[TU5n[X[U55 M& U$rO)rsetattrproperty)rrwrapped_methodmethodsrs r8wrappermirror_from..wrappers/F$]F;N C.!9 : r:)rrPrr rWr )rtype[T]rWrr)rrrrs`` @r8 mirror_fromrs' Nr:c## Uv g7frOrrs r8 nullcontextr s Isc j[U[5(d[e[U[5(dU/[U5-n[U[5(dU/[U5-n[U5[U5:wd[U5[U5:wa[e[U5S::aXU4$UVs/sH of=(d SPM nnU(a%S[ [ [ XU5565upnU(aUSSnUSSnUSSn [S[U55Hn X X S- :XaU ScMX X S- :wdXU S- U:dUbIX*US- U:a;URX 5 URX5 U RX*5 MX*U S'M XxU 4$XU4$s snf)aeMerge adjacent byte-offset ranges when the inter-range gap is <= `max_gap`, and when the merged byte range does not exceed `max_block` (if specified). By default, this function will re-order the input paths and byte ranges to ensure sorted order. If the user can guarantee that the inputs are already sorted, passing `sort=False` will skip the re-ordering. rrc38# UHn[U5v M g7frO)list)rvs r8r&merge_offset_ranges..2s!  GGrNr) rr TypeErrorrbrdzipsortedrappend) rstartsendsmax_gap max_blocksortr new_paths new_startsnew_endsrRs r8merge_offset_rangesrs eT " " fd # #CJ& dD ! !vE " 6{c%j CIU$; 6{ad""$ %ff1ffF %  t, t "1I BQZ 8q#e*%Ax5Q<'HRL,@Ea%L(Y"-8)twB/G9.T  *!!&),( $w !&"h.. $ M&s1F0cUR5nURSS5URU5 $!URU5 f=f)z+Find length of any open read-mode file-liker)r^ra)filelikeposs r8 file_sizerXs9 --/C}}Q" c cs 5Ac## [R"[RR U5[RR U5S-S9up#[ X!5nUv SSS5 [R"X05 g!,(df  N%=f![aL [R"[5 [R"U5 SSS5 e!,(df  e=ff=f7f)z A context manager that opens a temporary file next to `path` and, on exit, replaces `path` with the temporary file, thereby updating `path` atomically. -)dirprefixN) tempfilemkstemprFrdirnamebasenameopenrr contextlibsuppressFileNotFoundErrorunlink)rmodefdfnfps r8 atomic_writeras   GGOOD !"''*:*:4*@3*FFB "^rH 2^   !2 3 IIbM4 4 3 sNAC1 B#B(B0C1 BB$C.<C C. C* &C..C1c/nURnS[U5peXV:GaXnUS-nUS:XaU(aUSULaU"U5 GOUS:Xa U"U5 GOUS:XGaUnX:a XS:XaUS-nX:a XS:XaUS-nX:aXS:waUS-nX:a XS:waMX:a U"S 5 GOXUn S U ;aU RS S 5n O/n XS:XaUS -OUS-n URS X5n U S:aOU RXU 5 U S-nU S-n M8XUn U (aU RU 5 O U S==S - ss'[ [U 5S- SS5H1n XS- SXS:dMXS- SSXSS-XS- 'X M3 S R SU 55n [ R"SSU 5n US-nU (d U"S5 OXU S:Xa U"S5 OIU SS:Xa SU SS-n OU SS;aS U -n U"SU S35 OU"[ R"U55 XV:aGMXV:XdeU$)Nrr*r?[!]z\[r\\\rc3d# UH&oRSS5RSS5v M( g7f)rrrz\-N)rrs r8r_translate..s,%LRq $.66sEBBFs.0z([&~|])z\\\1z(?!)rE^)r#r) rrbrfindrr,r(subescape) patSTAR QUESTION_MARKresaddrRncjstuffchunkskchunks r8 _translater3vsC **C c#hq % F E 8CG4/D #X   #XAu3Eu3E%CFcME%CFcMvE ae#!MM$6EF!$3AAEAHHS!/q5! cAh/EE  !HE e,r c) "3v;?Ar:!a%=,vy|;,2q5M#2,>12,NFq5M & ;  HH%LR%Ez7E:EKc\HQx3 #eABiqZ/ $u !E7! %  ! A %B 6M6 Jr:cP[RR(a6[RR[RR-nO[RRnSR [ [ RU55n[U5S:aSUS3OUnSUS3nUS3nUU3nSUS3nS n/n [ R"X05n [U 5S- n [U 5HupU S :XaU RX:aUOU5 M%U S :XaU RX:aUOU5 MES U ;a [S 5eU (aU R[XS 3U55 X:dMU RU5 M SR U 5nS US3$)zBTranslate a pathname with shell wildcards to a regular expression.rrrz[^+z(?:.+z)?z.*rz**z:Invalid pattern: '**' can only be an entire path componentz(?s:z)\Z)rFraltsepsepr,mapr(r&rbr enumeraterrdextendr3)r'seps escaped_sepsany_sepnot_sepone_last_segment one_segment any_segmentsany_last_segmentsresultsr last_part_idxidxpartr*s r8glob_translaterHsy  ww~~ww{{RWW^^+ww{{773ryy$/0L%(Y],q! G<."G!!}%&wi0K7)2&LG HHW "EJNMu%  3; NN#*=;CS T  4< NN3+>rcs" &   "+. CLDHR R+@RRlAE   (=   " " n! :.'j# G G G  G  G  G  G T*@ !.8F "  * * * * *  *Z*G6%)"  !     *%,!(   C C C C C  C  C,CL (GT#r: