7Th-VSSKJr SSKrSSKrSSKrSSKrSSKrSSKrSSKrSSK J r SSK J r SSK Jr SSKJrJr SSKJr SS KJrJr SS KJr SS KJr SS KJrJrJrJrJ r J!r!J"r" \RF"S 5r$Sr%"SS\&5r'"SS\'S9r("SS\RR5r*Sr+g)) annotationsN)ESPIPE) has_magic)sha256)AnyClassVar)DEFAULT_CALLBACK) apply_configconf)DirCache) Transaction)_unstrip_protocolglob_translate isfilelike other_paths read_blockstringify_pathtokenizefsspeccU"U0UD6$N)clsargskwargss C/var/www/auris/envauris/lib/python3.13/site-packages/fsspec/spec.py make_instancer s   c8^\rSrSrSrU4SjrU4SjrSrU=r$)_Cached$a Metaclass for caching file system instances. Notes ----- Instances are cached according to * The values of the class attributes listed in `_extra_tokenize_attributes` * The arguments passed to ``__init__``. This creates an additional reference to the filesystem, which prevents the filesystem from being garbage collected when all *user* references go away. A call to the :meth:`AbstractFileSystem.clear_instance_cache` must *also* be made for a filesystem instance to be garbage collected. c>[TU]"U0UD6 [R"S5(a[R "5UlO0Ul[R"5Ul g)Nweakref_instance_cache) super__init__r getweakrefWeakValueDictionary_cacheosgetpid_pid)rrr __class__s rr&_Cached.__init__5sK $)&) 88, - - 446CJCJ99;rc>^[TU5n[U4SjTR55n[TTR[ R "5/UQUQ70UD6nURSS5n[R"5TR:wa4TRR5 [R"5TlU(d7TR(a&UTR;aUTl TRU$[TT]<"U0UD6nXFlXlX&lUR&(aUR((aSSKJn U"U5 TR(aU(dUTl UTRU'U$)Nc3>># UHn[TUS5v M g7frgetattr).0attrrs r #_Cached.__call__..Cs! 1OGCt $ $1Osskip_instance_cacheFr )mirror_sync_methods)r tuple_extra_tokenize_attributesrr- threading get_identpopr+r,r*clearcachable_latestr%__call__ _fs_token_ storage_argsstorage_options async_implr9asyn) rrr extra_tokenstokenskipobjr9r.s ` rrB_Cached.__call__As2c6* 141O1O   9..0 37 :F JP zz/7 99;#(( " JJ   yy{CH #**)<CK::e$ $'"D3F3C"N# "( ~~#"9"95#C(||D# $' 5!Jrr) __name__ __module__ __qualname____firstlineno____doc__r&rB__static_attributes__ __classcell__)r.s@rr!r!$s rr!c\rSrSr%SrSrSrSrSrSr S\ S 'S r Sr Sr S r\rS rS \ S'S\ S'Sr\S5r\S5rSrSrSrSr\S5rSgSjr\S5r\S5r\S5r Sr!Sr"ShSjr#SiS jr$SjS!jr%S"r&SiS#jr'S$r(SkS%jr)SlS&jr*SmS'jr+ShS(jr,S)r-S*r.S+r/S,r0S-r1S.r2S/r3S0r4SnS1jr5SnS2jr6SoS3jr7SpS5jr8ShS6jr9SqS7jr:SrS8jr;\\jrBS?rCStS@jrDSuSAjrESuSBjrFSCrGSDrHSuSEjrI\SF5rJSvSGjrKSwSHjrLSiSIjrMSJrNShSKjrOSSL.SxSMjjrP\SySNj5rQSSL.SzSOjjrR\S{SPj5rSSQrTS|SRjrU\SS5rVSTrWSUrXS}S~SVjjrYSoSWjrZSXr[SiSYjr\SjSZjr]SiS[jr^S\r_S]r`S^raSS_jrbS`rcSuSajrdSjSbjreSjScjrfSSdjrgSerhSfrig )AbstractFileSystemaz An abstract super-class for pythonic file-systems Implementations are expected to be compatible with or, better, subclass from here. TFi@/abstractzClassVar[str | tuple[str, ...]]protocolNrztuple[Any, ...]rDdict[str, Any]rEcVUR(agSUlSUlSUl/Ul[ S0UD6UlUR SS5(a[R"S[5 UR SS5(a[R"S[5 SUl g) a+Create and configure file-system instance Instances may be cachable, so if similar enough arguments are seen a new instance is not required. The token attribute exists to allow implementations to cache instances if they wish. A reasonable default should be provided if there are no arguments. Subclasses should call this method. Parameters ---------- use_listings_cache, listings_expiry_time, max_paths: passed to ``DirCache``, if the implementation supports directory listing caching. Pass use_listings_cache=False to disable such caching. skip_instance_cache: bool If this is a cachable implementation, pass True here to force creating a new instance even if a matching instance exists, and prevent storing this instance. asynchronous: bool loop: asyncio-compatible IOLoop or None NTFadd_docsz add_docs is no longer supported. add_aliaseszadd_aliases has been removed.r) _cached_intrans _transaction"_invalidated_caches_in_transactionr dircacher>warningswarn FutureWarningrC)selfrrEs rr&AbstractFileSystem.__init__{s0 <<    24/ 3?3   z4 0 0 MM>2&&rcl[U[U55=(a URUR:H$r) isinstancetyperprgothers r__eq__AbstractFileSystem.__eq__s%%d,R5??1RRrcR[[U5URUR44$r)rr|rDrErls r __reduce__AbstractFileSystem.__reduce__s$tDz4+<+R>RSSSrc [U[5(a!UVs/sHo RU5PM sn$[U5n[UR[ 5(a UR4O URnUH[nUR US-5(aU[U5S-SnM/UR US-5(dMJU[U5S-SnM] URS5nU=(d UR$s snf)z}Turn path from fully-qualified to file-system-specific May require FS-specific handling, e.g., for relative paths or links. ://Nz::rW) r{list_strip_protocolrrYstr startswithlenrstrip root_marker)rpathpprotosrYs rr"AbstractFileSystem._strip_protocols dD ! !489Dq''*D9 9d#$.s||S$A$A#,,s||Hx%/00CMA-/0D11CMA-/0  {{3&s&:sDc[UR[5(a UR4O URnUH nURUS35(dMUs $ USSU3$)z6Format FS-specific path to generic, including protocolrr)r{rYrr)rgnamerrYs runstrip_protocol#AbstractFileSystem.unstrip_protocols`%/ s%C%C$--!H(3/00 )Cv&&rc0$)a>If kwargs can be encoded in the paths, extract them here This should happen before instantiation of the class; incoming paths then should be amended to strip the options in methods. Examples may look like an sftp path "sftp://user@host:/my/path", where the user and host should become kwargs and later get stripped. r)rs r_get_kwargs_from_urls(AbstractFileSystem._get_kwargs_from_urlss  rcvURUR;aURUR$U"5$)zqReturn the most recently instantiated FileSystem If no instance has been created, then create one with defaults )rAr*rs rcurrentAbstractFileSystem.currents. ;;#** $::ckk* *u rc`URcURU5UlUR$)zA context within which files are committed together upon exit Requires the file class to implement `.commit()` and `.discard()` for the normal and exception cases. )ratransaction_typerls r transactionAbstractFileSystem.transactions/    $ $ 5 5d ;D    rcTSUlURU5UlUR$)z@Begin write transaction for deferring files, non-context versionT)r`rrarrls rstart_transaction$AbstractFileSystem.start_transactions(  11$7rcURR5 SUlURHnUR U5 M URR 5 g)z-Finish write transaction, non-context versionN)rcompleterarbinvalidate_cacher?rgrs rend_transaction"AbstractFileSystem.end_transactionsL !!# ;;D  ! !$ '< //557rc^UR(aURRU5 gg)z Discard any cached directory information Parameters ---------- path: string or None If None, clear all listings cached else listings at or under given path. N)r`rbappendrs rr#AbstractFileSystem.invalidate_caches$ ==  3 3 : :4 @ rc g)a. Create directory entry at path For systems that don't have true directories, may create an for this instance only and not touch the real filesystem Parameters ---------- path: str location create_parents: bool if True, this is equivalent to ``makedirs`` kwargs: may be permissions, etc. Nrrgrcreate_parentsrs rmkdirAbstractFileSystem.mkdirs rcg)a2Recursively make directories Creates directory at path and any intervening required directories. Raises exception if, for instance, the path already exists but is a file. Parameters ---------- path: str leaf directory name exist_ok: bool (False) If False, will error if the target already exists Nrrgrexist_oks rmakedirsAbstractFileSystem.makedirs*s rcg)zRemove a directory, if emptyNrrs rrmdirAbstractFileSystem.rmdir: rc [e)aList objects at path. This should include subdirectories and files at that location. The difference between a file and a directory must be clear when details are requested. The specific keys, or perhaps a FileInfo class, or similar, is TBD, but must be consistent across implementations. Must include: - full path to the entry (without protocol) - size of the entry, in bytes. If the value cannot be determined, will be ``None``. - type of entry, "file", "directory" or other Additional information may be present, appropriate to the file-system, e.g., generation, checksum, etc. May use refresh=True|False to allow use of self._ls_from_cache to check for a saved listing and avoid calling the backend. This would be common where listing may be expensive. Parameters ---------- path: str detail: bool if True, gives a list of dictionaries, where each is the same as the result of ``info(path)``. If False, gives a list of paths (str). kwargs: may have additional backend-specific options, such as version information Returns ------- List of strings if detail is False, or list of directory information dicts if detail is True. rjrgrdetailrs rlsAbstractFileSystem.ls>s N"!rcURU5nURURS5$![a Of=fURUVs/sH3nUSU:Xd%USURS5:XdM&USS:XdM1UPM5 Os snfnn[ U5S:Xa [ U5eU$![a gf=f)zCheck cache for listing Returns listing, if found (may be empty list for a directly that exists but contains nothing), None if not in cache. rWrr| directoryrN)_parentrcrKeyErrorrFileNotFoundError)rgrparentffiless r_ls_from_cache!AbstractFileSystem._ls_from_cachegs d# ==S!12 2    v..AV9$fIS!1178i;6N.E 5zQ'--L   s61 >>B1%B<BB #B11 B>=B>c+# UbUS:a [S5eURU5n0n0n0nURSS5n UR"U4SS0UD6n U HSn U SRS 5n U RS S5S nU S S :XaX:wa XU'XU'MDX:XaXS 'MOXU'MU U (d[U5n[U5nU(aXU4v UbUS-nUS:aU(dXU4v gUH$nUR"Xo4UU US.UD6ShvN M& U(dXU4v gg![[ 4a)n US:Xae[ U5(aU"U 5 Sn A gSn A ff=fNS7f)aReturn all files under the given path. List all files, recursing into subdirectories; output is iterator-style, like ``os.walk()``. For a simple list of files, ``find()`` is available. When topdown is True, the caller can modify the dirnames list in-place (perhaps using del or slice assignment), and walk() will only recurse into the subdirectories whose names remain in dirnames; this can be used to prune the search, impose a specific order of visiting, or even to inform walk() about directories the caller creates or renames before it resumes walk() again. Modifying dirnames when topdown is False has no effect. (see os.walk) Note that the "files" outputted will include anything that is not a directory, such as links. Parameters ---------- path: str Root to recurse into maxdepth: int Maximum recursion depth. None means limitless, but not recommended on link-based file-systems. topdown: bool (True) Whether to walk the directory tree from the top downwards or from the bottom upwards. on_error: "omit", "raise", a callable if omit (default), path with exception will simply be empty; If raise, an underlying exception will be raised; if callable, it will be called with a single OSError instance as argument kwargs: passed to ``ls`` Nr maxdepth must be at least 1rFTraiserrWr|rrZ)maxdepthrtopdown) ValueErrorrr>rrOSErrorcallablerrsplitrwalk)rgrrron_errorr full_dirsdirsrrlistingeinfopathnamerds rrAbstractFileSystem.walksB  HqL:; ;##D) He, ggd:4:6:GDF|**3/H??3*2.DF|{*x/?"*$!T ! b "d :DKE e# #   MH!|e++Ayy !     e# #]"7+ 7"!!   L s<>E,D.CE,E*E,.E'>E"E,"E''E,c URU5n0nU(a/US:wa)URU5(aURU5Xa'UR"X4SS0UD6HVupxn U(aU R U5 UR U R 5V V s0sH upU SU _M sn n 5 MX U(dUR U5(a0Xa'[U5n U(dU $U V s0sHoXj_M sn $s sn n fs sn f)aeList all files below path. Like posix ``find`` command without conditions Parameters ---------- path : str maxdepth: int or None If not None, the maximum number of levels to descend withdirs: bool Whether to include directory paths in the output. This is True when used by glob, but users usually only want files. kwargs are passed to ``ls``. rZrTr)risdirrrupdateitemsisfilesorted) rgrrwithdirsrrout_rrrrnamess rfindAbstractFileSystem.finds ##D)  tzz$'7'7 $CI"iiNtNvNNAU T" JJU[[]K]ztV d*]K LOt{{4((CIs L056#)O6 6L7s D 2D c (0nU(a1URU5(aURU5nUSXgS'UR"U4X4S.UD6HnURU5nUSXgS'M U(a[UR 55$U$)aSpace used by files and optionally directories within a path Directory size does not include the size of its contents. Parameters ---------- path: str total: bool Whether to sum all the file sizes maxdepth: int or None Maximum number of directory levels to descend, None for unlimited. withdirs: bool Whether to include directory paths in the output. kwargs: passed to ``find`` Returns ------- Dict of {path: size} if total=False, or int otherwise, where numbers refer to bytes used. sizer)rr)rrrsumvalues) rgrtotalrrrsizesrrs rduAbstractFileSystem.dus*  4((99T?D"&v,Ev, 4P(PPA99Q.Xs-*s*?[rFrWrZrTrrrr|r)rrer+raltseprendswithrr:rrminr>rexistsrrindexcountrcompilerrmatchr)rgrrrrseps ends_with_sepappend_slash_to_dirnameidx_star idx_qmark idx_bracemin_idxrrootdepthidx_double_starsdepth_double_starsallpathspatternrrrs rglobAbstractFileSystem.glob&sR  HqL:; ;02 RWW^^,RWW[[N d+ ##D)"/# 4== -- -4 &*YYs^q%8499S>c$i&*iin&9DIIcNs4y &*iin&9DIIcNs4y h95He,{{4*6* 6M ))D";F";<<II D'N "8Gn++C0G 'A+&D1'--c2Q6ED1'--c2Q6E 4<##'99T? %)*;%<%B%B3%G!%K" 22X=99TXEDXQWX  2!FG**W%"(.."23 34}}*tF|{/JC AtG3   J9  s 2L:Lc :UR"U40UD6 g! g=f)z!Is there a file at the given pathTFrrgrrs rrAbstractFileSystem.existss%  IId %f % sc $URU5$)z=If there is a file at the given path (including broken links))rrs rlexistsAbstractFileSystem.lexistss{{4  rc (URU5nUR"URU54SS0UD6nUVs/sHoDSRS5U:XdMUPM nnU(aUS$UR"U4SS0UD6nURS5nUVs/sHoDSRS5U:XdMUPM nn[ U5S:XaSUS;aSUSS'US$[ U5S:dU(aUSS S .$[ U5es snfs snf) aGive details of entry at path Returns a single dictionary, with exactly the same information as ``ls`` would with ``detail=True``. The default implementation calls ls and could be overridden by a shortcut. kwargs are passed on to ```ls()``. Some file systems might not be able to measure the file's size, in which case, the returned dict will include ``'size': None``. Returns ------- dict with keys: name (full path in the FS), size (in bytes), type (file, directory, or something else) and other FS-specific keys. rTrrWrr rNr)rrr|)rrrrrr)rgrrroout1s rrAbstractFileSystem.infos"##D)ggdll4(@@@?#Q6!1!1#!6$!>q#? q6Mggd24262{{3@3aF)"2"23"74"?3@ t9>T!W$"&Q7N Y]c ![A A#D) )@ AsD D D6DcJ[[URU55S5$)arUnique value for current version of file If the checksum is the same from one moment to another, the contents are guaranteed to be the same. If the checksum changes, the contents *might* have changed. This should normally be overridden; default will probably capture creation/modification timestamp (which would be good) or maybe access timestamp (which would be bad) rv)rwrrrs rchecksumAbstractFileSystem.checksums8DIIdO,b11rcDURU5RSS5$)zSize in bytes of filerN)rr'rs rrAbstractFileSystem.sizesyy""6400rcNUVs/sHo RU5PM sn$s snf)z-Size in bytes of each file in a list of paths)r)rgpathsrs rrAbstractFileSystem.sizess &+,e ! e,,,s"cRURU5SS:H$![a gf=f)zIs this entry directory-like?r|rF)rrrs rrAbstractFileSystem.isdirs1 99T?6*k9 9  s  &&c@URU5SS:H$! g=f)zIs this entry file-like?r|fileFrrs rrAbstractFileSystem.isfiles) 99T?6*f4 4 sc UR"U4SUUUS.UD6nUR5sSSS5 $!,(df  g=f)zGet the contents of the file as a string. Parameters ---------- path: str URL of file on this filesystems encoding, errors, newline: same as `open`. rmodeencodingerrorsnewlineNopenread)rgrr0r1r2rrs r read_textAbstractFileSystem.read_textsLYY      668   s 3 Ac UR"U4SUUUS.UD6nURU5sSSS5 $!,(df  g=f)zWrite the text to the given file. An existing file will be overwritten. Parameters ---------- path: str URL of file on this filesystems value: str Text to write. encoding, errors, newline: same as `open`. wr.N)r4write)rgrvaluer0r1r2rrs r write_textAbstractFileSystem.write_textsNYY      775>   s 4 Ac UR"US40UD6nUb@US:aURU5 O(UR[SURU-55 Ub?US:aURU-nUR X5R 5- 5sSSS5 $UR 5sSSS5 $!,(df  g=f)a Get the content of a file Parameters ---------- path: URL of file on this filesystems start, end: int Bytes limits of the read. If negative, backwards from end, like usual python slices. Either can be None for start or end of file, respectively kwargs: passed to ``open()``. rbNr)r4seekmaxrr5tell)rgrstartendrrs rcat_fileAbstractFileSystem.cat_filesYYtT ,V , A:FF5MFF3q!&&5.127&&3,CvvcFFHn-- ,668- , ,sA>2D")--"5K"*&)$i ,,[9 d"%((MMO. -"%((MMO). -s%?EA7D2 E2#EE E&c [U[5(a[U[5(aUnUnGODSSKJn Jn Jn [U[ 5n URXUS9nU (aJU(aUb@UV s/sH+o"U 5(aMURU 5(aM)U PM- nn U(dg[U[ 5(aU "U5n[U5S:Hn[U[ 5=(a% U "U5=(d U "5RU5nU =(aH [U5=(a U=(d- [U5(+=(a U=(a U "U5(+n[UUUU (+S9nUR[U55 UR[X55H4up!URX5nUR "X4SU0UD6 SSS5 M6 gs sn f!,(df  MM=f)a$Copy file(s) to local. Copies a specific file or tree of files (if recursive=True). If lpath ends with a "/", it will be assumed to be a directory, and target files will go within. Can submit a list of paths, which may be glob-patterns and will be expanded. Calls get_file for each source. r rfmake_path_posix trailing_seprarNrflattenrp)r{rrirfrzr{rrbrrrrrjwraprWbranchedrv)rgrnrorarprrrpathslpathsrfrzr{ source_is_strrsource_is_file dest_is_dirrchilds rr'AbstractFileSystem.gets$ eT " "z%'>'>FF   'uc2M%%e8%TFi83G%+VVLO!tzzRS}!VV%%%'. [A-N$UC0U#E'8'>'>u'E #5!4nV!%((T[TeAT=T !)) F #f+&$MM#f*=>LE""50E eEUEfE10?1W210s0G"G"G"?G'' G6 c US:XaURU5(a[e[RR U5(aUR USS9 g[ US5nURSS5nURU5 URS5 URUR[R"U55SS9 UR "US40UD6nUR5U:aaURUR5n URU 5n U c [!U 5n UR#U 5 UR5U:aMaSSS5 SSS5 g!,(df  N=f!,(df  g=f) zCopy single file to remoterITrgNr?rrrJ)rrKr+rrrr4r@rjmkdirsrfspathrBr5rkr:rrl) rgrornrpr/rrsrf2rtrus rput_fileAbstractFileSystem.put_files* 8  E 2 2! ! 77==   MM%$M / % "771a=D   d # GGAJ KK RYYu%56K F5$1&1Rggi$&774>>2D"$((4.K"*&)$i ,,[9 ggi$&2   21  s&$A'>FF   'uc2M'. "B^^E^RFi83G%+TVLO!rxxPQ{!VT [A-N$UC0U#8tzz%'8  eS))$$U+7<=u!**1-u=  #5!4nV!%((T[TeAT=T !)) F #f+&$MM#f*=>LE""50E eEUEfE10?5U>10s$HH2H1H":H'' H6 c~URUS5nURU5sSSS5 $!,(df  g=f)z&Get the first ``size`` bytes from filer?Nr3rgrrrs rheadAbstractFileSystem.headHs) YYtT "a66$<# " "s. <cURUS5nUR[U*UR*5S5 UR 5sSSS5 $!,(df  g=f)z%Get the last ``size`` bytes from filer?rN)r4r@rArr5rs rtailAbstractFileSystem.tailMsD YYtT "a FF3uqvvg& *668# " "s 8A A#c [errjrgpath1path2rs rcp_fileAbstractFileSystem.cp_fileSs!!rc RUc U(aSnOUcSn[U[5(a[U[5(aUnUnGOSSKJn [U[5n UR XUS9nU (aJU(aUb@UV s/sH+o"U 5(aMUR U 5(aM)U PM- nn U(dg[U5S:Hn [U[5=(a U "U5=(d UR U5n U =(aH [U5=(a U =(d- [U5(+=(a U =(a U "U5(+n[UUUU (+S9n[Xx5HunnUR"UU40UD6 M gs sn f![a US:XaeM9f=f)aCopy within two locations in the filesystem on_error : "raise", "ignore" If raise, any not-found exceptions will be raised; if ignore any not-found exceptions will cause the path to be skipped; defaults to raise unless recursive is true, where the default is ignore Nignorerr )r{r|r}) r{rrir{rrbrrrrrWrr)rgrrrarrrpaths1paths2r{rrrrrp1p2s rcopyAbstractFileSystem.copyVs   H  H eT " "z%'>'>FF ;&uc2M%%e8%TFi83G%+VVLO!tzzRS}!VV [A-N$UC0U#8tzz%'8 #5!4nV!%((T[TeAT=T !)) F&)FB  R.v.*)W.% w&' s$>F F *F 3FF&%F&c UbUS:a [S5e[U[[R45(aUR U/X#5nGO [ 5nUVs/sHo`RU5PM nnUHn[U5(ai[ UR"U4SU0UD65nXW-nU(a>UbUS::aMGU[ UR "[U54UUbUS- OSS.UD65-nM|U(a$[ UR"U4USSS.UD65nXX-nXe;dMUSLdURU5(dMURU5 M U(d [U5e[U5$s snf) zTurn one or more globs or directories into a list of all matching paths to files or directories. kwargs are passed to ``glob`` or ``find``, which may in turn call ``ls`` Nr rrr|TFr)rr{rr+PathLikerbsetrrrrrraddrr) rgrrarrrrbitrecs rrbAbstractFileSystem.expand_paths}  HqL:; ; dS"++. / /""D69?C%C59:T((+TD:Q<<diiGHGGHCJC $/HM$s ,, $S *39A9MASW#)   (04QWC JC>GGAJ9:#D) )c{A;sE8c |X:Xa[RSU5 gURXX4SS9 URXS9 g)z)Move file(s) from one location to anotherz6%s mv: The paths are the same, so no files were moved.r)raronerrorr`N)loggerdebugrrm)rgrrrarrs rmvAbstractFileSystem.mvsA > LLQSW X II g   GGEG /rc&URU5 g)z Delete a fileN)_rmrs rrm_fileAbstractFileSystem.rm_files  rc[e)zDelete one filerjrs rrAbstractFileSystem._rms "!rcjURXUS9n[U5HnURU5 M g)asDelete files. Parameters ---------- path: str or list of str File(s) to delete. recursive: bool If file(s) are directories, recursively delete contents and then also remove the directory maxdepth: int or None Depth to pass to walk for finding files to delete, if recursive. If None, there will be no limit and infinite recursion may be possible. r|N)rbreversedr)rgrrarrs rrAbstractFileSystem.rms2HM$A LLO rcURU5nSU;a=URSS5SRUR5nURU-$UR$)NrWr r)rrlstripr)rrrs rrAbstractFileSystem._parentsV""4( $;[[a(+223??CF??V+ +?? "rc &[UUUUU4SU0UD6$)z4Return raw bytes-mode file-like from the file-system cache_options)AbstractBufferedFile)rgrr/ block_size autocommitrrs r_openAbstractFileSystem._opens4$       (    rc 0SSKnURU5nSU;afURSS5S-nSVs0sHnX;dM XRU5_M n nUR"UR "UU4UUUS.UD640U D6$URSUR (+5n UR"U4UUU US .UD6n Ub!SS KJ n SS K J n U "X5nXnU"XSS 9n U (d+S U;a%URRRU 5 U $s snf)a[ Return a file-like object from the filesystem The resultant instance must function correctly in a context ``with`` block. Parameters ---------- path: str Target file mode: str like 'rb', 'w' See builtin ``open()`` Mode "x" (exclusive write) may be implemented by the backend. Even if it is, whether it is checked up front or on commit, and whether it is atomic is implementation-dependent. block_size: int Some indication of buffering - this is a value in bytes cache_options : dict, optional Extra arguments to pass through to the cache. compression: string or None If given, open file using compression codec. Can either be a compression name (a key in ``fsspec.compression.compr``) or "infer" to guess the compression from the filename suffix. encoding, errors, newline: passed on to TextIOWrapper for text mode rNbtrZ)r0r1r2)rr compressionr)r/rrr)compr)get_compression)r/r-)iorreplacer> TextIOWrapperr4r`rfsspec.compressionr fsspec.corerrrr)rgrr/rrrrrrP text_kwargsacrrrcompresss rr4AbstractFileSystem.opensTD ##D) d?<<R(3.D;:A;!::a= :  ##  *"/ +      Ldmm*;>@@rcURUS5nURnUcUnUb X#-U:aXb- n[XRX45sSSS5 $!,(df  g=f)a2Read a block of bytes from Starting at ``offset`` of the file, read ``length`` bytes. If ``delimiter`` is set then we ensure that the read starts and stops at delimiter boundaries that follow the locations ``offset`` and ``offset + length``. If ``offset`` is zero then we start at zero. The bytestring returned WILL include the end delimiter string. If offset+length is beyond the eof, reads to eof. Parameters ---------- fn: string Path to filename offset: int Byte offset to start read length: int Number of bytes to read. If None, read to end. delimiter: bytes (optional) Ensure reading starts and stops at delimiter bytestring Examples -------- >>> fs.read_block('data/file.csv', 0, 13) # doctest: +SKIP b'Alice, 100\nBo' >>> fs.read_block('data/file.csv', 0, 13, delimiter=b'\n') # doctest: +SKIP b'Alice, 100\nBob, 200\n' Use ``length=None`` to read to the end of the file. >>> fs.read_block('data/file.csv', 0, None, delimiter=b'\n') # doctest: +SKIP b'Alice, 100\nBob, 200\nCharlie, 300' See Also -------- :func:`fsspec.utils.read_block` r?N)r4rr)rgfnoffsetlength delimiterrrs rrAbstractFileSystem.read_blockcsTJYYr4 A66D~FOd$:a; ! s ,A  A)include_passwordc TSSKJn [R"U[SU4SU05S9$)az JSON representation of this filesystem instance. Parameters ---------- include_password: bool, default True Whether to include the password (if any) in the output. Returns ------- JSON string with keys ``cls`` (the python location of this class), protocol (text name of this class's protocol, first one in case of multiple), ``args`` (positional args, usually empty), and all other keyword arguments as their own keys. Warnings -------- Serialized filesystems may contain sensitive information which have been passed to the constructor, such as passwords and tokens. Make sure you store and send them in a secure environment! r FilesystemJSONEncoder_FilesystemJSONEncoderrr)jsonrdumpsr|)rgrrs rto_jsonAbstractFileSystem.to_jsons5, 0zz (&(#%56  rc6SSKJn [R"XS9$)a Recreate a filesystem instance from JSON representation. See ``.to_json()`` for the expected structure of the input. Parameters ---------- blob: str Returns ------- file system instance, not necessarily of this particular class. Warnings -------- This can import arbitrary modules (as determined by the ``cls`` key). Make sure you haven't installed any modules that may execute malicious code at import time. r FilesystemJSONDecoderr)rrloads)blobrs r from_jsonAbstractFileSystem.from_jsons* 0zz$::rc SSKJn U"5n[U5nURn[ UR 5nU(dUR SS5 [ SURSUR3[U[[45(aUSOUURUR5S.URU5D6$) a JSON-serializable dictionary representation of this filesystem instance. Parameters ---------- include_password: bool, default True Whether to include the password (if any) in the output. Returns ------- Dictionary with keys ``cls`` (the python location of this class), protocol (text name of this class's protocol, first one in case of multiple), ``args`` (positional args, usually empty), and all other keyword arguments as their own keys. Warnings -------- Serialized filesystems may contain sensitive information which have been passed to the constructor, such as passwords and tokens. Make sure you store and send them in a secure environment! r rpasswordN:r)rrYrr)rrr|rYrOrEr>rNrMr{r:rmake_serializablerD)rgrr json_encoderrprotorEs rto_dictAbstractFileSystem.to_dicts, 0,. 4j t334    D 1 >>"!CLL>2!+EE4=!A!AU1Xu//0A0AB ,,_=   rc$SSKJn U"5n[U5nURU5nUc [ S5eUR SS5 UR SS5 U"UR UR SS550UR U5D6$) a Recreate a filesystem instance from dictionary representation. See ``.to_dict()`` for the expected structure of the input. Parameters ---------- dct: Dict[str, Any] Returns ------- file system instance, not necessarily of this particular class. Warnings -------- This can import arbitrary modules (as determined by the ``cls`` key). Make sure you haven't installed any modules that may execute malicious code at import time. r rNz#Not a serialized AbstractFileSystemrrYrr)rrrOtry_resolve_fs_clsrr>unmake_serializable)dctr json_decoderrs r from_dictAbstractFileSystem.from_dicts* 0,. 3i#66s; ;BC C t  D!  - -cggfb.A B ..s3  rcU$)zG Make a version of the FS instance which will be acceptable to pyarrow rrls r_get_pyarrow_filesystem*AbstractFileSystem._get_pyarrow_filesystems  rc"SSKJn U"UUUUUS9$)zCreate key/value store based on this file-system Makes a MutableMapping interface to the FS at the given root path. See ``fsspec.mapping.FSMap`` for further details. r )FSMap)checkrImissing_exceptions)mappingr)rgr r rIr rs r get_mapperAbstractFileSystem.get_mapper s# #  1   rc8URR5 g)al Clear the cache of filesystem instances. Notes ----- Unless overridden by setting the ``cachable`` class attribute to False, the filesystem class stores a reference to newly created instances. This prevents Python's normal rules around garbage collection from working, since the instances refcount will not drop to zero until ``clear_instance_cache`` is called. N)r*r?rs rclear_instance_cache'AbstractFileSystem.clear_instance_cache0s rc[e)z=Return the created timestamp of a file as a datetime.datetimerjrs rcreatedAbstractFileSystem.created?!!rc[e)z>Return the modified timestamp of a file as a datetime.datetimerjrs rmodifiedAbstractFileSystem.modifiedCrrc S#Sjn /n U(aU RU5 U(GaSU-n URUSS9n U RSS9 Ub#[U 5U:aU SUn [U 5U- nOU n Sn[ U 5GHunnU[U 5S - :H=(a US:HnU(a S S US - --O S S US - --nUS- nUU(aU O SSUS - ---n[ R RURSS55nU(aURS5S:XaURURSS5SS9n[SU55n[SU55nUS:Xa US:XaSnOUS:XaSUSUS :aSOSS3nOsUS:XaSUSUS :aSOSS3nO[SUSUS :aSOSSUSUS :aSOSS3 nO;U(a2URS5S:XaSU "URSS55S3nOSnU RUUUU35 URS5S:XdGMUS:dGMU RURURSS5US - UUUUSUS95 GM US:a&US 3nU RUS S US - --SU35 S!RS"U 55$)$ai Return a tree-like structure of the filesystem starting from the given path as a string. Parameters ---------- path: Root path to start traversal from recursion_limit: Maximum depth of directory traversal max_display: Maximum number of items to display per directory display_size: Whether to display file sizes prefix: Current line prefix for visual tree structure is_last: Whether current item is last in its level first: Whether this is the first call (displays root path) indent_size: Number of spaces by indent Returns ------- str: A string representing the tree structure. Example ------- >>> from fsspec import filesystem >>> fs = filesystem('ftp', host='test.rebex.net', user='demo', password='password') >>> tree = fs.tree(display_size=True, recursion_limit=3, indent_size=8, max_display=10) >>> print(tree) cNSHupUSU-:dMX- SSUS3s $ US3$)zFormat bytes as text.))Pl )Tl)Gi@)Mi)rPg?z.2f rBr)nprefixrPs r format_bytes-AbstractFileSystem.tree..format_bytesmsA a<eC[&33S7NrrT)rcNURS5S:gURSS54$)Nr|rrrZr')xs r)AbstractFileSystem.tree..s!quuV} ;QUU62=NOr)keyNrr u└u─ru├u│rrZr|rc3R# UHoRS5S:XdMSv M g7f)r|r*r Nr&r4sub_items rr6*AbstractFileSystem.tree..s$$*6h,,v:NRX:X,s' 'c3T# UHnURS5S:XdMSv M g7f)r|rr Nr&r,s rr6r.s*&(4H#<</;>(4s( (z (empty folder)z (z subfolderr\)z file, r*rF)rrecursion_limit max_display display_sizer"is_lastfirst indent_sizez more item(s) not displayed. c36# UHo(dM Uv M g7frr)r4rs rr6r.s0FqaFs  )r!rwrUr) rrsortr enumerater+rbasenamer'rtreejoin)rgrr2r3r4r"r5r6r7r#resultindentcontentsdisplayed_contentsremaining_countiitem is_last_itembranch new_prefixr sub_contents num_files num_foldersr more_messages rr=AbstractFileSystem.treeGs`L   MM$  ;&FwwtDw1H MMO  &3x=;+F%-l{%;""%h-+"=%-""#$%784 !S);%88F#{27JMM !%&"!5,;a,?(3)5#-$0"'(3"  Y9r""1!22NO  huq(ABC1\NSyy0F000rc ,UR"U4X#S.UD6$)z'Alias of `AbstractFileSystem.cat_file`.rCrD)rE)rgrrCrDrs r read_bytesAbstractFileSystem.read_bytess}}TBB6BBrc *UR"X40UD6 g)z(Alias of `AbstractFileSystem.pipe_file`.N)rL)rgrr;rs r write_bytesAbstractFileSystem.write_bytess t-f-rc ,UR"U4SU0UD6$)z$Alias of `AbstractFileSystem.mkdir`.r)rrs rmakedirAbstractFileSystem.makedirszz$H~HHHrc URXS9$)z'Alias of `AbstractFileSystem.makedirs`.rg)rrs rrAbstractFileSystem.mkdirss}}T}55rc ,UR"U4SU0UD6$)z!Alias of `AbstractFileSystem.ls`.r)rrs rlistdirAbstractFileSystem.listdirswwt5F5f55rc (UR"X40UD6$)z#Alias of `AbstractFileSystem.copy`.)rrs rcpAbstractFileSystem.cpsyy000rc (UR"X40UD6$z!Alias of `AbstractFileSystem.mv`.rrs rmoveAbstractFileSystem.movewwu.v..rc (UR"U40UD6$)z#Alias of `AbstractFileSystem.info`.rrs rstatAbstractFileSystem.statsyy(((rc ,UR"U4X#S.UD6$)z!Alias of `AbstractFileSystem.du`.)rr)r)rgrrrrs r disk_usageAbstractFileSystem.disk_usageswwtF5FvFFrc (UR"X40UD6$rarbrs rrenameAbstractFileSystem.renamererc"URXUS9$)z!Alias of `AbstractFileSystem.rm`.r|)r)rgrrars rdeleteAbstractFileSystem.deleteswwt8wDDrc ,UR"X4SU0UD6$)z"Alias of `AbstractFileSystem.put`.ra)r)rgrornrars ruploadAbstractFileSystem.uploadxxD DVDDrc ,UR"X4SU0UD6$)z"Alias of `AbstractFileSystem.get`.rar&)rgrnrorars rdownloadAbstractFileSystem.downloadrurc [S5e)aCreate a signed URL representing the given path Some implementations allow temporary URLs to be generated, as a way of delegating credentials. Parameters ---------- path : str The path on the filesystem expiration : int Number of seconds to enable the URL for (if supported) Returns ------- URL : str The signed URL Raises ------ NotImplementedError : if method is not implemented for a filesystem z+Sign is not implemented for this filesystemrj)rgr expirationrs rsignAbstractFileSystem.signs,""OPPrcg)NFrrls r _isfilestoreAbstractFileSystem._isfilestores r)r_rCr`rbrarc)rrrUrr)TF)NTomit)NFF)TNF)NNN)NN)rG)NrU)Fr)r)FNN)FN)r?NTN)r?NNN)rboolrUr)rrrUrU)rrrUr[)rr[rUrU)rZFFN)rWrFrZTT)rrr2rwr3rwr4rr"rr5rr6rr7rwrUr)TN)d)jrMrNrOrPrQr@r_rkrrY__annotations__rArFr9rrrr;r&propertyrmrprsrxrr classmethodrr staticmethodrrrrrrrrrrrrrrrrrrr rrrrr6r<rErLrRr]rcr rvr'rrrrrrrbrrrrrrr4rrrrrrrrr rrrr=rPrSrVrr[r^rcrgrjrmrprsrwr{r~rRrrrrUrUasHGI C0:H-:GJK""$"!##'R"" 'ST''$'  !! 8A" $  '"R2\$|$7L DiV! *D 21-(@D"229.;C D&5P/?$D! <F~&6K:8! @FD  "FJ4l.` 0" &##  . L\&"A+abr?rJxbzFile mode not supportedr?r)corerrrrr/DEFAULT_BLOCK_SIZErklocrrDrCclosedrdrerfr>rrkrdetails _fetch_rangecacherBytesIObufferrforcedlocation) rgrrrr/rr cache_typerrrrs rr&AbstractBufferedFile.__init__1sL !  '15F'FD # #J $   M V  MMJ  %+JJv$6M& ! / /%&?@ @ 4<  LL0 + 1 1499@MDJ**,DKDKDK DMrcURc*URRUR5UlUR$r)_detailsrrrrrls rrAbstractBufferedFile.detailss. ==  GGLL3DM}}rc$XlUSUlg)Nr)rr)rgr;s rrrs &M rcB[URUR5$r)rrrrrls r full_nameAbstractBufferedFile.full_names DGG44rc[USS5$)N_closedTr2rls rrAbstractBufferedFile.closedstY--rcXlgr)r)rgcs rrrs rcvSUR;a [U5$[[UR5S5$)Nr9rv)r/idrwrrrls rrxAbstractBufferedFile.__hash__s- $)) d8Ox -r2 2rcXLag[U[U55=(aC URS:H=(a- URS:H=(a [U5[U5:H$)zAFiles are equal if they have the same checksum, only in read modeTr?)r{r|r/hashr}s rrAbstractBufferedFile.__eq__sV = ud4j ) * T! * d" *T d5k)  rcg)z#Move from temp to final destinationNrrls rcommitAbstractBufferedFile.commitrcg)zThrow away temporary fileNrrls rdiscardAbstractBufferedFile.discardrrcZUR5(a UR$[S5e)z File information about this pathz Info not available while writing)readablerrrls rrAbstractBufferedFile.infos# ==??<< ?@ @rcUR$)zCurrent file location)rrls rrBAbstractBufferedFile.tells xxrc&[U5nURS:Xd[[S5eUS:XaUnO;US:XaURU-nO%US:XaUR U-nO[ SUS35eUS:a [ S5eX0lUR$) zSet current file location Parameters ---------- loc: int byte location whence: {0, 1, 2} from start of file, current location or end of file, resp. r?z Seek only available in read moderr rzinvalid whence (z, should be 0, 1 or 2)zSeek before start of file)rwr/rrrrr)rgrwhencenlocs rr@AbstractBufferedFile.seeks#hyyD &"DE E Q;D q[88c>D q[99s?D/x7MNO O !889 9xxrcUR5(d [S5eUR(a [S5eUR(a [S5eURR U5nU=R U- slURR5UR:aUR5 U$)z Write data to buffer. Buffer only sent on flush() or if buffer is greater than or equal to blocksize. Parameters ---------- data: bytes Set of bytes to be written. zFile not in write modeI/O operation on closed file.z0This file has been force-flushed, can only close) writablerrrrr:rrBrkflush)rgrtrs rr:AbstractBufferedFile.writes}}56 6 ;;<= = ;;OP Pkk% C ;;    / JJL rcFUR(a [S5eU(aUR(a [S5eU(aSUlUR5(agU(d)URR 5UR :agURcSUlUR5 URUS9SLaJU=RURRSS5- sl[R"5Ulgg! SUle=f) a3 Write buffered data to backend store. Writes the current buffer, if it is larger than the block-size, or if the file is being closed. Parameters ---------- force: bool When closing, write the last block even if it is smaller than blocks are allowed to be. Disallows further writing to this file. zFlush on closed filez+Force flush cannot be called more than onceTNr)finalFr) rrrrrrBrkr_initiate_upload _upload_chunkr@rr)rgforces rrAbstractBufferedFile.flushs ;;34 4 T[[JK K DK ==?? ))+dnn<  ;; DK %%'   E  *% 7 KK4;;++Aq1 1K**,DK 8  " s )D D cg)zWrite one part of a multi-block file upload Parameters ========== final: bool This is the last block, so should complete file, if self.autocommit is True. Nr)rgrs rr"AbstractBufferedFile._upload_chunkrrcg)zCreate remote file/uploadNrrls rr%AbstractBufferedFile._initiate_upload$rrcJURRURXS9$)z*Get the specified set of bytes from remoterO)rrrEr)rgrCrDs rr!AbstractBufferedFile._fetch_range(s ww @@rcUcSO [U5nURS:wa [S5eUS:aURUR- nUR (a [S5eUS:XagUR RURURU-5n[RSUURURU-UR R55 U=R[U5- slU$)z Return data from cache, or fetch pieces as necessary Parameters ---------- length: int (-1) Number of bytes to read; if <0, all remaining bytes. rr?zFile not in read moderrrz%s read: %i - %i %s) rwr/rrrrr_fetchrr _log_statsr)rgrrs rr5AbstractBufferedFile.read,s~3v; 99 45 5 A:YY)F ;;<= = Q;jj$((V*;< !  HH HHv  JJ ! ! #   CH rc[U5RS5nURUR5nX2S[ U5&[ U5$)zhmirrors builtin file's readinto method https://docs.python.org/3/library/io.html#io.RawIOBase.readinto r N) memoryviewcastr5nbytesr)rgrrrts rreadintoAbstractBufferedFile.readintoKsB m  %yy$Kc$i4yrc/nUR5nURU=(d UR5n[U5S:XaOjUR U5nUS:a@UR USU[U5-5 UR XF-[U5-5 OUR U5 MSRU5$)aKReturn data between current position and first occurrence of char char is included in the output, except if the end of the tile is encountered first. Parameters ---------- char: bytes Thing to find blocks: None or int How much to read in each go. Defaults to file blocksize - which may mean a new read on every call. rrNr)rBr5rkrrrr@r>)rgcharblocksrrCpartfounds r readuntilAbstractBufferedFile.readuntilUsIIKE99V5t~~6D4yA~IIdOErz 4 3%#d)"345 %-#d)34 JJt xx}rc$URS5$)zRead until and including the first occurrence of newline character Note that, because of character encoding, this is not necessarily a true line ending.  )rrls rreadlineAbstractBufferedFile.readlineqs ~~e$$rc@UR5nU(aU$[er)r StopIteration)rgrs r__next__AbstractBufferedFile.__next__ysmmo JrcU$rrrls r__iter__AbstractBufferedFile.__iter__ rcUR5nURS5nUSSVs/sHo3S-PM nnURS5(aU$XBS/-$s snf)zPReturn all data, split by the newline character, including the newline characterrNr)r5splitr)rgrtlineslrs r readlinesAbstractBufferedFile.readliness_yy{ 5!"'*-*Q5y*- ==  J)$ $ .sAc$URU5$r)r)rgrs r readinto1AbstractBufferedFile.readinto1s}}Qrc[USS5(agUR(agURS:XaSUlOUR(dUR SS9 UR bcUR RUR5 UR RUR RUR55 SUlg!SUlf=f)z-Close file Finalizes writes, discards cache _unclosableFNr?T)r) r3rr/rrrrrrrrrls rrmAbstractBufferedFile.closes 4 . .  ;;  yyD ! {{JJTJ*77&GG,,TYY7GG,,TWW__TYY-GHDK$DKs B(C C cPSUR;=(a UR(+$)zWhether opened for readingr-r/rrls rrAbstractBufferedFile.readablesdii3 O3rc"UR5$)z'Whether is seekable (only in read mode))rrls rseekableAbstractBufferedFile.seekables}}rcPURS;=(a UR(+$)zWhether opened for writing>rrJrrrls rrAbstractBufferedFile.writablesyy..Bt{{?Brc HURS:wa [S5e[URURURUR UR URURUR(aURROSUR4 4$)Nr?z*Pickling a writeable file is not supportednone) r/ RuntimeErrorreopenrrrrkrrrrrrrls rrAbstractBufferedFile.__reduce__sw 99 KL L GG II II NN HH II OO#zzDJJOOv KK   rcHUR(dUR5 ggr)rrmrls r__del__AbstractBufferedFile.__del__s{{ JJLrcbS[UR5RSURS3$)Nz)r|rrrMrrls r__str__AbstractBufferedFile.__str__s*#DM$:$:#;2dii[JJrcU$rrrls r __enter__AbstractBufferedFile.__enter__rrc$UR5 gr)rm)rgrs r__exit__AbstractBufferedFile.__exit__s  r)rrrrkrrrrDrrrrrrr/rrrrC)r?rT readaheadNN)rr)r)rN),rMrNrOrPrQrrr&rrsetterrrrxrrrrrBr@r:rrrrr5rrrrrrrrmrrrrr r __repr__rrrRrrrrr%s8#H  O!b  ^^""55..  ]]3  2(A40('T  A>8% % ,4C KHrrc fUR"U4UUUUUS.UD6n US:aU RU5 U $)N)r/rrrrr)r4r@) rrrr/rkrrrrrr*s rrrsJ 77        D Qw # Kr), __future__rrrloggingr+r<rdr(errnorrrhashlibrtypingrr callbacksr configr r rcr rrutilsrrrrrrr getLoggerrrr|r!rUIOBaserrrrrr#s"   '&$   8 $ :d:zA7AH6j299jZ r