7Th);SSKrSSKrSSKrSSKrSSKJrJr SSKJr SSK J r "SS\ 5r "SS\5r "S S \ 5rg) N) HTTPAdapterRetry)AbstractFileSystem)AbstractBufferedFilec0^\rSrSrSrSU4SjjrSrU=r$)DatabricksException z4 Helper class for exceptions raised in this module. cH>[TU]U5 XlX lX0lg)z Create a new DatabricksExceptionN)super__init__ error_codemessagedetails)selfr rr __class__s S/var/www/auris/envauris/lib/python3.13/site-packages/fsspec/implementations/dbfs.pyr DatabricksException.__init__s !$  )rr rN)__name__ __module__ __qualname____firstlineno____doc__r __static_attributes__ __classcell__rs@rrr srrc^\rSrSrSrU4SjrSSjrSSjrSSjrSSjr SSjr SS jr S r SS jr S rS rSrSU4SjjrSrU=r$)DatabricksFileSystemz{ Get access to the Databricks filesystem implementation over HTTP. Can be used inside and outside of a databricks cluster. c X>XlX l[R"5Ul[ SS/SQS9UlURRS[UR S95 URRRSSUR305 [TU]0"S 0UD6 g ) au Create a new DatabricksFileSystem. Parameters ---------- instance: str The instance URL of the databricks cluster. For example for an Azure databricks cluster, this has the form adb-..azuredatabricks.net. token: str Your personal token. Find out more here: https://docs.databricks.com/dev-tools/api/latest/authentication.html g?)iiiiii)totalbackoff_factorstatus_forcelisthttps://) max_retries AuthorizationzBearer N) instancetokenrequestsSessionsessionrretriesmountrheadersupdater r )rr*r+kwargsrs rr DatabricksFileSystem.__init__ s!  '') ;  :{t||'LM ##_ |6L$MN "6"rc URU5nU(d\URSSSU0S9nUR S/5nUVs/sHnUSUS(aS OS US S .PM nnX@RU'U(aU$UVs/sHoS PM sn$![a,nURS:Xa[ UR 5UeeSnAff=fs snfs snf)z List the contents of the given path. Parameters ---------- path: str Absolute path detail: bool Return not only the list of filenames, but also additional information on file sizes and types. getlistpathmethodendpointjsonRESOURCE_DOES_NOT_EXISTNfilesis_dir directoryfile file_size)nametypesizerC)_ls_from_cache _send_to_apirr FileNotFoundErrorrr6dircache) rr8detailr3outrer>os rlsDatabricksFileSystem.ls<s!!$' %% 6&EE'2&E  A fI+,X;KFkN  #&MM$  J#&'3a& 3''%' <<#<<+AII6A=   (s#B"C C C 'CC cU(d#URSSSU0S9 [SUS35eURS S SU0S9 UR UR U55 g![anURS:XaSnANUSnAff=f![a,nURS :Xa[UR5UeeSnAff=f) z Create a given absolute path and all of its parents. Parameters ---------- path: str Absolute path to create exist_ok: bool If false, checks if the folder exists before creating it (and raises an Exception if this is the case) r6z get-statusr8r9zPath z already existsr=NpostmkdirsRESOURCE_ALREADY_EXISTS)rGFileExistsErrorrr rinvalidate_cache_parent)rr8exist_okrMs rmakedirsDatabricksFileSystem.makedirscs !! 'B99B>c DU(d[eUR"U40UD6 g)z Create a given absolute path and all of its parents. Parameters ---------- path: str Absolute path to create create_parents: bool Whether to create all parents or not. "False" is not implemented so far. N)NotImplementedErrorrS)rr8create_parentsr3s rmkdirDatabricksFileSystem.mkdirs% % D#F#rc URSSXS.S9 UR URU55 g![aLnURS:XaURXS9 eURS:Xa[ UR 5UeeSnAff=f)z Remove the file or folder at the given absolute path. Parameters ---------- path: str Absolute path what to remove recursive: bool Recursively delete all files in a folder. rRdelete)r8 recursiver9PARTIAL_DELETEIO_ERRORN)rGrr rmOSErrorrrVrW)rr8rbr3rMs rreDatabricksFileSystem.rms    !";   dll401# ||//T7  +aii(a/  s6 B ABB c U(a[eU(a[eURSSXS.S9 URURU55 URURU55 g![aRnURS:Xa[ UR 5UeURS:Xa[ UR 5UeeSnAff=f)ah Move a source to a destination path. A note from the original [databricks API manual] (https://docs.databricks.com/dev-tools/api/latest/dbfs.html#move). When moving a large number of files the API call will time out after approximately 60s, potentially resulting in partially moved data. Therefore, for operations that move more than 10k files, we strongly discourage using the DBFS REST API. Parameters ---------- source_path: str From where to move (absolute path) destination_path: str To where to move (absolute path) recursive: bool Not implemented to far. maxdepth: Not implemented to far. rRmove) source_pathdestination_pathr9r=rTN) r\rGrr rHrrUrVrW)rrjrkrbmaxdepthr3rMs rmvDatabricksFileSystem.mvs2 % % % %    %0W   dll;78 dll+;<=# ||88' 29!::%aii0a7   sA00 C :A CC c [X4X#S.UD6$)z Overwrite the base class method to make sure to create a DBFile. All arguments are copied from the base method. Only the default blocksize is allowed. )mode block_size)DatabricksFile)rr8rprqr3s r_openDatabricksFileSystem._opensdUtUfUUrcUS:XaURRnO+US:XaURRnO[SU35e[R R SURS3U5nU"XSS9nUR5 UR5$![Ra>nURR5nO![a USef=f[S0UD6UeSnAff=f) aF Send the given json to the DBFS API using a get or post request (specified by the argument `method`). Parameters ---------- method: str Which http method to use for communication; "get" or "post". endpoint: str Where to send the request to (last part of the API URL) json: dict Dictionary of information to send rRr6zDo not understand method r&z/api/2.0/dbfs/)r<Nr))r.rRr6 ValueErrorurllibparseurljoinr*raise_for_statusr, HTTPErrorresponser< Exceptionr) rr:r;r< session_callurlrLrMexception_jsons rrG!DatabricksFileSystem._send_to_apis V <<,,L u_<<++L8AB Bll""Xdmm_N#KXV  ( ?   vvx!! ? "!"!2 "T! "&77Q > ?s*>BC03C C+CC++C0cURSSXS.S9nUS$![a,nURS:Xa[UR5UeeSnAff=f)a Internal function to create a handle, which can be used to write blocks of a file to DBFS. A handle has a unique identifier which needs to be passed whenever written during this transaction. The handle is active for 10 minutes - after that a new write transaction needs to be created. Make sure to close the handle after you are finished. Parameters ---------- path: str Absolute path for this file. overwrite: bool If a file already exist at this location, either overwrite it or raise an exception. rRcreate)r8 overwriter9handlerTN)rGrr rUr)rr8rrLrMs r_create_handle#DatabricksFileSystem._create_handlese$ !!!";"A X; " ||88%aii0a7   s A'A  AcURSSSU0S9 g![a,nURS:Xa[UR5UeeSnAff=f)z{ Close a handle, which was opened by :func:`_create_handle`. Parameters ---------- handle: str Which handle to close. rRcloserr9r=N)rGrr rHr)rrrMs r _close_handle"DatabricksFileSystem._close_handle1sR    VgXvDV  W" ||88' 29   s A 'AA c2[R"U5R5nURSSXS.S9 g![aRnUR S:Xa[ UR5UeUR S:Xa[UR5UeeSnAff=f)aB Upload data to an already opened file handle (opened by :func:`_create_handle`). The maximal allowed data size is 1MB after conversion to base64. Remember to close the handle when you are finished. Parameters ---------- handle: str Which handle to upload data to. data: bytes Block of data to add to the handle. rRz add-blockrdatar9r=MAX_BLOCK_SIZE_EXCEEDEDN) base64 b64encodedecoderGrr rHrrv)rrrrMs r _add_dataDatabricksFileSystem._add_dataBs%,,.    $ &5   # ||88' 29!:: +2   s: BA BBc URSSXX2- S.S9n[R"US5$![aRnURS:Xa[ UR 5UeURS;a[UR 5UeeSnAff=f) a) Download data in bytes from a given absolute path in a block from [start, start+length]. The maximum number of allowed bytes to read is 1MB. Parameters ---------- path: str Absolute path to download data from start: int Start position of the block end: int End position of the block r6read)r8offsetlengthr9rr=)INVALID_PARAMETER_VALUEMAX_READ_SIZE_EXCEEDEDN)rGr b64decoderr rHrrv)rr8startendrLrMs r _get_dataDatabricksFileSystem._get_data`s !!"s{K"A ##AfI. ." ||88' 29!VV +2   s.1 B A BB c>UcURR5 OURRUS5 [TU]U5 gr)rIclearpopr rV)rr8rs rrV%DatabricksFileSystem.invalidate_cache~s9 < MM   ! MM  dD )  &r)r*r/r.r+)TF)FN)rbdefaultr)rrrrrr rOrYr^rermrsrGrrrrrVrrrs@rrrsZ #8%(N2B$"2<HL,>\V'R>"<<''rrc^^\rSrSrSrSrS U4SjjrSrS SjrSr S Sjr S r U=r $) rriz@ Helper class for files referenced in the DatabricksFileSystem. ic >UbUS:Xa URnX@R:Xd SU35e[T U]"UU4UUUUU=(d 0S.UD6 g)zZ Create a new instance of the DatabricksFile. The blocksize needs to be the default one. Nrz,Only the default block size is allowed, not )rprq autocommit cache_type cache_options)DEFAULT_BLOCK_SIZEr r ) rfsr8rprqrrrr3rs rr DatabricksFile.__init__sz  y!800J444 ::, G 4    !!!'-2  rcXURRUR5Ulg)z(Internal function to start a file uploadN)rrr8r)rs r_initiate_uploadDatabricksFile._initiate_uploadsgg,,TYY7 rcURRS5 URR5nUR[ U55VVs/sH up4X#UPM nnnUH'nUR R URUS9 M) U(a$UR RURS9 ggs snnf)zrsE 0%, ) i'-i'X N')N'r