ITh8 B%SrSSKrSSKrSSKrSSKrSSKJr SSKJr SSK J r SSK J r J r JrJrJrJrJrJrJrJrJrJrJrJr SSKJr SSKJrJrJrJ r J!r!J"r" S S K#J$r$J%r%J&r&J'r' S S K(J)r)J*r* \ (aSS K+J,r,J-r- SSK.J/r/ \0r1\\0\ 4r2\\3\4r4\\4\2\14r5SS1r6\Rn"\85r9\"SS55r:\"SS55r;Sr\S\5S\\44Sj5r?\S\SS\\S4Sj5r?\S\\5S\\\4SS44Sj5r?S\5S\04Sjr@S\0SS4S jrAS\3S\4S!jrBS\3S\4S"jrCS\3SS4S#jrDS$\\3\4S\4S%jrES&\\3S'\FS\\\0\\*44S(jrGS&\\3S'\FS\\\0\\*44S)jrHS*\3S'\FS\\\0\*44S+jrIS,\\3S\\)4S-jrJS,\\3S\\)4S.jrKS*\3S\\)4S/jrLS0S1S$S2S\\34S3jrM0rN\\\0\\04\OS4'S5\\0S6\\0SS4S7jrPS5\\0S\\04S8jrQS9\S\4S:jrRS;\\0S<\\0S\ 4S=jrSg)>zEContains utilities used by both the sync and async inference clients.N)contextmanager) dataclass)Path) TYPE_CHECKINGAny AsyncIterableBinaryIOContextManagerDict GeneratorIterableListLiteralNoReturnOptionalUnionoverload) HTTPError)GenerationErrorIncompleteGenerationErrorOverloadedErrorTextGenerationError UnknownErrorValidationError) get_sessionis_aiohttp_availableis_numpy_availableis_pillow_available)ChatCompletionStreamOutputTextGenerationStreamOutput)ClientResponse ClientSessionImagez text-to-imagezimage-to-imagecz\rSrSr%\\S'\\S'\\\S'\\\\\ 4\S'\\ \S'\\\ 4\S'Sr g ) RequestParametersHurltaskmodeljsondataheadersN) __name__ __module__ __qualname____firstlineno__str__annotations__rrr rContentTr__static_attributes__r0Y/var/www/auris/envauris/lib/python3.13/site-packages/huggingface_hub/inference/_common.pyr(r(HsE H I C= 5dD) ** 8  #s(^r9r(cB\rSrSr%Sr\\S'\\S'\\S'\\S'Sr g) ModelStatusSa' This Dataclass represents the model status in the HF Inference API. Args: loaded (`bool`): If the model is currently loaded into HF's Inference API. Models are loaded on-demand, leading to the user's first request taking longer. If a model is loaded, you can be assured that it is in a healthy state. state (`str`): The current state of the model. This can be 'Loaded', 'Loadable', 'TooBig'. If a model's state is 'Loadable', it's not too big and has a supported backend. Loadable models are automatically loaded when the user first requests inference on the endpoint. This means it is transparent for the user to load a model, except that the first call takes longer to complete. compute_type (`Dict`): Information about the compute resource the model is using or will use, such as 'gpu' type and number of replicas. framework (`str`): The name of the framework that the model was built with, such as 'transformers' or 'text-generation-inference'. loadedstate compute_type frameworkr0N) r1r2r3r4__doc__boolr6r5r r8r0r9r:r<r<Ss, L JNr9r<cB[5(d [S5eSSKnU$)NzMPlease install aiohttp to use `AsyncInferenceClient` (`pip install aiohttp`).r)r ImportErroraiohttp)rFs r:_import_aiohttprGts  ! !ijj Nr9cB[5(d [S5eSSKnU$)z.Make sure `numpy` is installed on the machine.zGPlease install numpy to use deal with embeddings (`pip install numpy`).rN)rrEnumpy)rIs r: _import_numpyrJ}s   cdd Lr9cF[5(d [S5eSSKJn U$)z,Make sure `PIL` is installed on the machine.zPlease install Pillow to use deal with images (`pip install Pillow`). If you don't want the image to be post-processed, use `client.post(...)` and get the raw response from the server.rr%)rrEPILr&r%s r:_import_pil_imagerMs(   `   Lr9contentreturncgNr0rNs r:_open_as_binaryrSs"r9cgrQr0rRs r:rSrSs%(r9c#*# [U[5(aURS5(dURS5(a>[R SU35 [ 5R U5Rv g[U5nUR5(d[SUS35e[U[5(a7[R SU35 URS5nUv SSS5 gUv g!,(df  g=f7f) zOpen `content` as a binary file, either from a URL, a local path, or raw bytes. Do nothing if `content` is None, TODO: handle a PIL.Image as input TODO: handle base64 as input zhttps://zhttp://zDownloading content from NzFile not found at z. If `data` is a string, it must either be a URL or a path to a local file. To pass raw content, please encode it as bytes first.zOpening content from rb) isinstancer5 startswithloggerdebugrgetrNrexistsFileNotFoundErroropen)rNfs r:rSrSs'3   j ) )W-?-? -J-J LL4WI> ?-##G,44 4 w-~~#$WI.OO  '4   ,WI67 \\$ 1G   sC-D/D4D D Dc[U5n[U[5(aUOUR5n[R "U5R 5sSSS5 $!,(df  g=f)z\Encode a raw file (image, audio) into base64. Can be bytes, an opened file, a path or a URL.N)rSrWbytesreadbase64 b64encodedecode)rNr. data_as_bytess r: _b64_encodergsH  !T *4 7 7TYY[  .557 " ! !s A A!! A/ encoded_imager&c[5nUR"[R"[R "U555$)z/Parse a base64-encoded string into a PIL Image.)rMr^ioBytesIOrc b64decode)rhr&s r: _b64_to_imagerms-  E ::bjj!1!1-!@A BBr9cJ[R"UR55$)aSParse bytes from a Response object into a Python list. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_dict` and will not complain if the returned data is a dictionary. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. r-loadsrerRs r:_bytes_to_listrq ::gnn& ''r9cJ[R"UR55$)aSParse bytes from a Response object into a Python dictionary. Expects the response body to be JSON-encoded data. NOTE: This is exactly the same implementation as `_bytes_to_list` and will not complain if the returned data is a list. The only advantage of having both is to help the user (and mypy) understand what kind of data to expect. rorRs r:_bytes_to_dictrtrrr9cb[5nUR"[R"U55$)zParse bytes from a Response object into a PIL Image. Expects the response body to be raw bytes. To deal with b64 encoded images, use `_b64_to_image` instead. )rMr^rjrk)rNr&s r:_bytes_to_imagervs$  E ::bjj) **r9responsec\[U[5(a[R"U5$U$rQ)rWrar-rp)rws r:_as_dictrys"#-h#>#>4::h LHLr9bytes_output_as_linesdetailsc#j# UHn[X!5nUcMUv M g![a  gf=f7f)z*Used in `InferenceClient.text_generation`.N%_format_text_generation_stream_output StopIterationrzr{ byte_payloadoutputs r: _stream_text_generation_responsers@ .  :<QF  L .    3 "3 3 0303cz# UShvN n[X!5nUcMU7v M!N![a  gf=f g7f)z/Used in `AsyncInferenceClient.text_generation`.Nr}rs r:&_async_stream_text_generation_responsersK 4l :<QF  L    44;9&9; (;;9 6;6;rcURS5(dgUR5S:Xa [S5eURS5n[R "UR S5RS55nURS5b[USURS55e[R"U5nU(dURR$U$ Nsdata:s data: [DONE]z[DONE] signal received.zutf-8zdata:z/nerror error_type)rXstriprrer-rplstriprstripr[_parse_text_generation_errorr"parse_obj_as_instancetokentext)rr{payload json_payloadrs r:r~r~s  " "8 , ,.566!!'*G::gnnW5<EcI\I\IaIaIc G$[[. 0C '  s AA$$ A1rrcUS:Xa [U5$US:Xa [U5$US:Xa [U5$US:Xa [U5$[ U5$)N generationincomplete_generation overloaded validation)rrrrr)rrs r:rrsZ\!u%%,,(//\!u%%\!u%%  r9)TrBrcrjr-logging contextlibr dataclassesrpathlibrtypingrrrr r r r r rrrrrrrequestsrhuggingface_hub.errorsrrrrrrutilsrrrr_generated.typesr!r"rFr#r$ PIL.Imager&r5UrlTPathTraBinaryTr7TASKS_EXPECTING_IMAGES getLoggerr1rYr(r<rGrJrMrSrgrmrqrtrvryrCrrr~rrrrrr6rrrrr0r9r:rsL %!"_^T5  c4i x  %% &*+;<   8 $    @  " "G" "  ( T](GDM"( ( Xh/Ihw>OQUW[>[4\>88c8CCC (E(d((E(d(+U+w+MuUD[)MdM #E? 59  8C=(#=> >?  (/ :>  = }-GH HI 88"&8 eC33458, %  ()  u% -. JJ ()J*O?OTabgTh0GI#T(3-c*B%CHY8C=YVZ[^V_YdhY>8C=>T#Y>I(6  8C= Uh r9