7Th%4SrSSKrSSKrSSKrSSKrSSKrSSKJrJr SSK r \Rr \Rr\rSSKrSrSrSrSrS rS rS rS r\R6SS j5rSSjrSrSSjrSr g!\ a Sr Ndf=f!\ a SrNSf=f)zFUtilities for fast persistence of big data, with optional compression.N) _COMPRESSORS _ZFILE_PREFIXicP[USU5n[U[R5$)z=Check if fileobj is a raw file object, e.g created with open.raw)getattr isinstanceioFileIO)fileobjs Q/var/www/auris/envauris/lib/python3.13/site-packages/joblib/numpy_pickle_utils.py _is_raw_filer&s!gug.G gryy ))c[R"5Vs/sHn[UR5PM nnU[[5/- n[ U5$s snfN)rvalueslenprefixrmax) compressorprefixess r _get_prefixes_max_lenr,sN9E9L9L9NO9N:J%%&9NHO ]#$$H x=PsAc[RS:H=(a URRS:H=(dq URRS:H=(aQ URR=(a4 [ SURRR 555=(d [RS:H=(a URRS:H=(dq URRS:H=(aQ URR=(a4 [ SURRR 555$)z2Check if numpy array is having byte order mismatchbig<|c3D# UHoSRS:Hv M g7f)rrN byteorder.0es r 6_is_numpy_array_byte_order_mismatch..<S7R!!#-7R little>c3D# UHoSRS:Hv M g7f)rr(Nrr s r r#r$Fr%r&)sysrdtypefieldsallrarrays r #_is_numpy_array_byte_order_mismatchr03s  KK ! !S (  %%,TKK&&TSu{{7I7I7P7P7RSS  ! KK ! !S (  %%,TKK&&TSu{{7I7I7P7P7RSS#rc[U5(a8UR5RURR S55nU$)zrUse the byte order of the host while preserving values Does nothing if array already uses the system byte order. =)r0byteswapviewr+ newbyteorderr.s r _ensure_native_byte_orderr6Ls: +511 %%ekk&>&>s&CD Lrc\[5n[US5(aURU5nO"URU5nUR S5 UR [ 5(ag[R"5H)up4UR UR5(dM'Us $ g)zReturn the compressor matching fileobj. Parameters ---------- fileobj: file object Returns ------- str in {'zlib', 'gzip', 'bz2', 'lzma', 'xz', 'compat', 'not-compressed'} peekrcompatnot-compressed) rhasattrr8readseek startswithrritemsr)r max_prefix_len first_bytesnamers r _detect_compressorrCXs+,Nwll>2 ll>2  Qm,, , 2 2 4 D%%j&7&788 !5 rc4[R"U[S9$)z0Return a buffered version of a read file object. buffer_size)r BufferedReader_IO_BUFFER_SIZEfobjs r _buffered_read_filerKx  T ??rc4[R"U[S9$)z1Return a buffered version of a write file object.rE)r BufferedWriterrHrIs r _buffered_write_filerO}rLrc## [U5nUnUS:Xa#[R"SU-[SS9 X4v gU[;a%[UnUR U5n[ U5nUbSn[U[R5(a![R"S[5-SS9 OZUS:wa![R"S[5-SS9 O3[U5(d![R"S [5-SS9 OUnX4v g7f) aUtility function opening the right fileobject from a filename. The magic number is used to choose between the type of file object to open: * regular file object (default) * zlib file object * gzip file object * bz2 file object * lzma file object (for xz and lzma compressor) Parameters ---------- fileobj: file object filename: str filename path corresponding to the fileobj parameter. mmap_mode: str memory map mode that should be used to open the pickle file. This parameter is useful to verify that the user is not trying to one with compression. Default: None. Returns ------- a tuple with a file like object, and the validated mmap_mode. r9zjThe file '%s' has been generated with a joblib version less than 0.10. Please regenerate this pickle file.) stacklevelNzuIn memory persistence is not compatible with mmap_mode "%(mmap_mode)s" flag passed. mmap_mode option will be ignored.r:ztmmap_mode "%(mmap_mode)s" is not compatible with compressed file %(filename)s. "%(mmap_mode)s" flag will be ignored.zP"%(fileobj)r" is not a raw file, mmap_mode "%(mmap_mode)s" flag will be ignored.) rCwarningswarnDeprecationWarningrdecompressor_filerKr r BytesIOlocalsr)r filename mmap_modervalidated_mmap_modecompressor_wrapperinsts r _validate_fileobject_and_memmapr^s%6$G,J#X   24< =   ++  %".j!9 %77@D)$/G  "& '2::.. 8:@(C !  // <>DhG !  "'** <>DhG  '0#**sD D cUSnUSnU[R"5;a![URXS9n[U5$[SRXS9n[U5$)z6Return the right compressor file object in write mode.rr) compresslevelzlib)rkeyscompressor_filerO)rYcompresscompressmethodr` file_instances r _write_fileobjectrgsza[NQKM**,,$^4DD E $M22$V,<< = $M22ric,[5nURU[U5- 5nX4- n[U5S:Xd[U5U:XaOMD[U5U:waSn[ XRU[U54-5eU$![Ra NDf=f)a_Read from file-like object until size bytes are read. TODO python2_drop: is it still needed? The docstring mentions python 2.6 and it looks like this can be at least simplified ... Raises ValueError if not EOF is encountered before size bytes are read. Non-blocking objects only supported if they derive from io objects. Required as e.g. ZipExtFile in python 2.6 can return less data than requested. This function was taken from numpy/lib/format.py in version 1.10.2. Parameters ---------- fp: file-like object size: int error_template: str Returns ------- a bytes object The data read in bytes. rz)EOF: reading %s, expected %d bytes got %d)bytesr<rr BlockingIOError ValueError)fpsizeerror_templatedatarmsgs r _read_bytesrrs4 7D  s4y()A ID1v{c$i4/0  4yD9c$i@@AA !!   s?A<<BBcj[RSSnUS:XaSSKJn O US:XaSSKJn W"U0UD6$)NrQz1.r) _reconstructz2.)np __version__numpy.core.multiarrayrtnumpy._core.multiarray)argskwargsnp_major_versionnp_reconstructs r rtrts; ~~bq)4H T !I 4 *6 **rr))ra)zran out of data)!__doc__ contextlibr pickler*rSrrrnumpyru ImportError _Unpickler Unpickler_PicklerPicklerrangexrangebz2rHrrr0r6rCrKrOcontextmanagerr^rg BUFFER_SIZErrrtrr rsL  3    //   * 2@@ @  M+M+`3( *Z +M B Cs"A>B >B B  BB