IThc % S r SSKrSSKrSSKrSSKrSSKrSSKrSSKJr SSK J
r
SSK J r SSK
JrJrJrJrJrJrJr SSKrSSKJrJr SSKJr SS KJr SS
K J r S S K J r S S
K J!r!J"r"J#r#J$r$J%r%J&r&J'r' SSK J(r( SSK)J*r* SSK+J,r, SSK-J.r. \(R^ " \05 r1Sr2Sr3\Rh " S\Rj S9r6 " S S\5 r7 " S S\5 r8S\Rr 4S jr:\/ \Rr 4 r;\:q<\;\=S ' \:4S \;SS4S jjr>S\Rr 4S jr?S?S! jr@\S"\AS#\AS\Rr 4S$ j5 rBS%SS&\R \R 4\
R S'.S(\.S)\FS*\AS+\GS,\GS-\\\H \\\H S.4 4 S/\\A\\AS.4 4 S\4S0 jjrIS)\FS1\\F S\F4S2 jrJS@S3\S4\\F SS4S5 jjrKS6\\% S7\FS3\S\%4S8 jrLS9\R6 S\F4S: jrM\Rh " S;\R 5 rOS<\\F S=\AS\\F 4S> jrPg)Az>Contains utilities to handle HTTP requests in Huggingface Hub. N) lru_cache)
HTTPStatus)quote)AnyCallableListOptionalTupleTypeUnion) HTTPErrorResponse) HTTPAdapter)PreparedRequest)OfflineModeIsEnabled ) constants)BadRequestErrorDisabledRepoErrorEntryNotFoundErrorGatedRepoErrorHfHubHTTPErrorRepositoryNotFoundErrorRevisionNotFoundError )logging)JSONDecodeError) SliceFileObj)
HTTP_METHOD_TX-Amzn-Trace-Idz x-request-ida
# staging or production endpoint
^https://[^/]+
(
# on /api/repo_type/repo_id
/api/(models|datasets|spaces)/(.+)
|
# or /repo_id/resolve/revision/...
/(.+)/resolve/(.+)
)
)flagsc D ^ \ rS rSrSrU 4S jrS\S\4U 4S jjrSr U =r
$ )UniqueRequestIdAdapterK r c > [ TU ] " U40 UD6 [ UR ; aU UR R [
5 =( d [
[ R " 5 5 UR [ ' [ [
UR R SS5 5 5 S: n[ R SUR [ SUR SUR SU S3 5 g ) N
authorization r zRequest z: z (authenticated: ))super add_headersX_AMZN_TRACE_IDheadersget X_REQUEST_IDstruuiduuid4lenloggerdebugmethodurl)selfrequestkwargs has_token __class__s S/var/www/auris/envauris/lib/python3.13/site-packages/huggingface_hub/utils/_http.pyr+ "UniqueRequestIdAdapter.add_headersN s
G.v. '// 1/6/B/B>:J!GKK=Xijsittu v
r9 returnc L > [ R ( a! [ R S[ U5 35 [
TU ] " U/UQ70 UD6$ ! [ R aB nUR R [ 5 nUb / UR QSU S3P7Ul e SnAff = f)zSCatch any RequestException to append request id to the error message for debugging.zSend: Nz
(Request ID: r) )
r HF_DEBUGr4 r5 _curlifyr* sendrequestsRequestExceptionr- r. r, args)r8 r9 rG r: e
request_idr< s r= rD UniqueRequestIdAdapter.send[ s LL6(7"3!45 6 7<9$9&9 9(( ,,_=J%A166A]:,a#@A s A
B#!=B B# ) __name__
__module__ __qualname____firstlineno__r, r+ r r rD __static_attributes__
__classcell__)r< s @r= r# r# K s% 'O
O r? r# c & \ rS rSrS\S\4S jrSrg)OfflineAdapteri r9 r@ c 4 [ SUR S35 e)Nz
Cannot reach za: offline mode is enabled. To disable it, please unset the `HF_HUB_OFFLINE` environment variable.)r r7 )r8 r9 rG r: s r= rD OfflineAdapter.sendj s& "GKK= )J
K
r? rK N)rL rM rN rO r r rD rP rK r? r= rS rS i s
O
r? rS r@ c . [ R " 5 n [ R ( a6 U R S[ 5 5 U R S[ 5 5 U $ U R S[
5 5 U R S[
5 5 U $ )Nzhttp://zhttps://)rE Sessionr HF_HUB_OFFLINEmountrS r# )sessions r= _default_backend_factoryr\ p sm G
i !12
j."23 N
i!7!9:
j"8":; Nr? _GLOBAL_BACKEND_FACTORYbackend_factoryc U q [ 5 g)ao
Configure the HTTP backend by providing a `backend_factory`. Any HTTP calls made by `huggingface_hub` will use a
Session object instantiated by this factory. This can be useful if you are running your scripts in a specific
environment requiring custom configuration (e.g. custom proxy or certifications).
Use [`get_session`] to get a configured Session. Since `requests.Session` is not guaranteed to be thread-safe,
`huggingface_hub` creates 1 Session instance per thread. They are all instantiated using the same `backend_factory`
set in [`configure_http_backend`]. A LRU cache is used to cache the created sessions (and connections) between
calls. Max size is 128 to avoid memory leaks if thousands of threads are spawned.
See [this issue](https://github.com/psf/requests/issues/2766) to know more about thread-safety in `requests`.
Example:
```py
import requests
from huggingface_hub import configure_http_backend, get_session
# Create a factory function that returns a Session with configured proxies
def backend_factory() -> requests.Session:
session = requests.Session()
session.proxies = {"http": "http://10.10.1.10:3128", "https": "https://10.10.1.11:1080"}
return session
# Set it as the default session factory
configure_http_backend(backend_factory=backend_factory)
# In practice, this is mostly done internally in `huggingface_hub`
session = get_session()
```
N)r] reset_sessions)r^ s r= configure_http_backendra s @ .r? c b [ [ R " 5 [ R " 5 S9$ )a
Get a `requests.Session` object, using the session factory from the user.
Use [`get_session`] to get a configured Session. Since `requests.Session` is not guaranteed to be thread-safe,
`huggingface_hub` creates 1 Session instance per thread. They are all instantiated using the same `backend_factory`
set in [`configure_http_backend`]. A LRU cache is used to cache the created sessions (and connections) between
calls. Max size is 128 to avoid memory leaks if thousands of threads are spawned.
See [this issue](https://github.com/psf/requests/issues/2766) to know more about thread-safety in `requests`.
Example:
```py
import requests
from huggingface_hub import configure_http_backend, get_session
# Create a factory function that returns a Session with configured proxies
def backend_factory() -> requests.Session:
session = requests.Session()
session.proxies = {"http": "http://10.10.1.10:3128", "https": "https://10.10.1.11:1080"}
return session
# Set it as the default session factory
configure_http_backend(backend_factory=backend_factory)
# In practice, this is mostly done internally in `huggingface_hub`
session = get_session()
```
process_id thread_id)_get_session_from_cacheosgetpid threading get_identrK r? r= get_sessionrk s : #biikYEXEXEZ [[r? c , [ R 5 g)zReset the cache of sessions.
Mostly used internally when sessions are reconfigured or an SSLError is raised.
See [`configure_http_backend`] for more details.
N)rf cache_clearrK r? r= r` r` s '')r? rd re c [ 5 $ )z
Create a new session per thread using global factory. Using LRU cache (maxsize 128) to avoid memory leaks when
using thousands of threads. Cache is cleared when `configure_http_backend` is called.
)r] rc s r= rf rf s
# $$r? ) max_retriesbase_wait_time
max_wait_timeretry_on_exceptionsretry_on_status_codesr6 r7 rq rr rs rt .ru c X [ U[ 5 ( a U4n[ U[ 5 ( a U4nSnUn Sn
SU; a; [ US [ R [
45 ( a US R
5 n
[ 5 n US-
n U
b US R U
5 U R " SXS.UD6n U R U; a U $ [ R SU R SU SU 35 X: a U R 5 U $ [ R S U S U S
U S35 [" R$ " U 5 [' XIS- 5 n M ! U aX n
[ R S U
S
U SU 35 [ U
[ R 5 ( a
[! 5 X: a U
e Sn
A
NSn
A
ff = f)ag
Wrapper around requests to retry calls on an endpoint, with exponential backoff.
Endpoint call is retried on exceptions (ex: connection timeout, proxy error,...)
and/or on specific status codes (ex: service unavailable). If the call failed more
than `max_retries`, the exception is thrown or `raise_for_status` is called on the
response object.
Re-implement mechanisms from the `backoff` library to avoid adding an external
dependencies to `hugging_face_hub`. See https://github.com/litl/backoff.
Args:
method (`Literal["GET", "OPTIONS", "HEAD", "POST", "PUT", "PATCH", "DELETE"]`):
HTTP method to perform.
url (`str`):
The URL of the resource to fetch.
max_retries (`int`, *optional*, defaults to `5`):
Maximum number of retries, defaults to 5 (no retries).
base_wait_time (`float`, *optional*, defaults to `1`):
Duration (in seconds) to wait before retrying the first time.
Wait time between retries then grows exponentially, capped by
`max_wait_time`.
max_wait_time (`float`, *optional*, defaults to `8`):
Maximum duration (in seconds) to wait before retrying.
retry_on_exceptions (`Type[Exception]` or `Tuple[Type[Exception]]`, *optional*):
Define which exceptions must be caught to retry the request. Can be a single type or a tuple of types.
By default, retry on `requests.Timeout` and `requests.ConnectionError`.
retry_on_status_codes (`int` or `Tuple[int]`, *optional*, defaults to `503`):
Define on which status codes the request must be retried. By default, only
HTTP 503 Service Unavailable is retried.
**kwargs (`dict`, *optional*):
kwargs to pass to `requests.request`.
Example:
```
>>> from huggingface_hub.utils import http_backoff
# Same usage as "requests.request".
>>> response = http_backoff("GET", "https://www.google.com")
>>> response.raise_for_status()
# If you expect a Gateway Timeout from time to time
>>> http_backoff("PUT", upload_url, data=data, retry_on_status_codes=504)
>>> response.raise_for_status()
```
When using `requests` it is possible to stream data by passing an iterator to the
`data` argument. On http backoff this is a problem as the iterator is not reset
after a failed call. This issue is mitigated for file objects or any IO streams
by saving the initial position of the cursor (with `data.tell()`) and resetting the
cursor between each call (with `data.seek()`). For arbitrary iterators, http backoff
will fail. If this is a hard constraint for you, please let us know by opening an
issue on [Github](https://github.com/huggingface/huggingface_hub).
r Ndatar )r6 r7 z HTTP Error z thrown while requesting r( 'z' thrown while requesting z Retrying in z s [Retry /z].r rK )
isinstancetypeintioIOBaser tellrk seekr9 status_coder4 warningraise_for_statusrE ConnectionErrorr` timesleepmin)r6 r7 rq rr rs rt ru r: nb_tries
sleep_timeio_obj_initial_posr[ responseerrs r= http_backoffr s N %t,, 2 4'--!6 8 H J
Jvf~ <7P Q Q #F^ 0 0 2mG
A
"-v##$67 HfHHH##+@@
NN[)=)=(>>WX^W__`ad`ef g%))+ & j\8*Ak]RTUV
: Q7
G * # NNQse#=fXQseL M#x 7 788 % &
s E F)AF$$F)endpointc U( a UR S5 O[ R nU[ R [ R 4; a@ U R [ R U5 n U R [ R U5 n U $ )zReplace the default endpoint in a URL by a custom one.
This is useful when using a proxy and the Hugging Face Hub returns a URL with the default endpoint.
ry )rstripr ENDPOINT_HF_DEFAULT_ENDPOINT _HF_DEFAULT_STAGING_ENDPOINTreplace)r7 r s r= fix_hf_endpoint_in_urlr S sf
(0xs#Y5G5GH 66 8^8^__kk)88(Ckk)@@(K Jr? r
endpoint_namec U R 5 g! [ Ga nU R R S5 nU R R S5 nUS:X a4 U R S3S- SU R
S3- n[
[ XP5 UeUS:X a4 U R S3S- S U R
S3- n[
[ XP5 UeUS
:X a4 U R S3S- S U R
S3- n[
[ XP5 UeUS :X a: U R S3S- S
U R
S3- S- S - n[
[ XP5 UeUS:X dd U R S:X a US:w a U R bx U R R
ba [ R U R R
5 b7 U R S3S- SU R
S3- S- n[
[ XP5 UeU R S:X a Ub SU S3OSn[
[ XP5 UeU R S:X a8 SU R SU S3SU R
S3- S - n[
[ XP5 UeU R S :X aZ U R R R S 5 nU S U S U R R S!5 S3n[
[ XP5 Ue[
[ [# U5 U 5 UeSnAff = f)"a
Internal version of `response.raise_for_status()` that will refine a
potential HTTPError. Raised exception will be an instance of `HfHubHTTPError`.
This helper is meant to be the unique method to raise_for_status when making a call
to the Hugging Face Hub.
Example:
```py
import requests
from huggingface_hub.utils import get_session, hf_raise_for_status, HfHubHTTPError
response = get_session().post(...)
try:
hf_raise_for_status(response)
except HfHubHTTPError as e:
print(str(e)) # formatted message
e.request_id, e.server_message # details returned by server
# Complete the error message with additional information once it's raised
e.append_to_message("
`create_commit` expects the repository to exist.")
raise
```
Args:
response (`Response`):
Response from the server.
endpoint_name (`str`, *optional*):
Name of the endpoint that has been called. If provided, the error message
will be more complete.
Raises when the request has failed:
- [`~utils.RepositoryNotFoundError`]
If the repository to download from cannot be found. This may be because it
doesn't exist, because `repo_type` is not set correctly, or because the repo
is `private` and you do not have access.
- [`~utils.GatedRepoError`]
If the repository exists but is gated and the user is not on the authorized
list.
- [`~utils.RevisionNotFoundError`]
If the repository exists but the revision couldn't be find.
- [`~utils.EntryNotFoundError`]
If the repository exists but the entry (e.g. the requested file) couldn't be
find.
- [`~utils.BadRequestError`]
If request failed with a HTTP 400 BadRequest error.
- [`~utils.HfHubHTTPError`]
If request failed for a reason not listed above.
z X-Error-CodeX-Error-MessageRevisionNotFoundz Client Error.
z Revision Not Found for url: .
EntryNotFoundzEntry Not Found for url: GatedRepoz!Cannot access gated repo for url z$Access to this resource is disabled.z!Cannot access repository for url
RepoNotFoundi z+Invalid credentials in Authorization headerNz Repository Not Found for url: z
Please make sure you specified the correct `repo_id` and `repo_type`.
If you are trying to access a private or gated repo, make sure you are authenticated. For more details, see https://huggingface.co/docs/huggingface_hub/authenticationi z
Bad request for z
endpoint:z
Bad request:i z Forbidden: z
Cannot access content at: z2
Make sure your token has the correct permissions.i Rangez. Requested range: z. Content-Range: z
Content-Range)r r
r- r. r r7 _formatr r r r r9 REPO_API_REGEXsearchr r r r0 )r r rH
error_code
error_messagemessage range_headers r= hf_raise_for_statusr ` sV pJ?!!# H? %%)).9
((,,->?
+ +!--.n=FKghphthtguuvIwwG/C J
?
*!--.n=FKdemeqeqdrrsIttG,g@a G
;
&''(7&@EfgogsgsfttuCvv
.'
) C ' !NN , $$0 %%h&6&6&:&:;G ''(728<<.BCNN
17E1 L
!
!S
(DQD]&}oZ@cu
/7=1 D
!
!S
(x++,L qI0 a@AGH
.'QH?s K!J>K K!
error_typecustom_messagec / nUR R S5 nUb UR U5 UR 5 nUR S5 nUb8 [ U[
5 ( a UR
U5 OUR U5 UR S5 nUb% U H nSU; d M UR US 5 M! U V s/ s H< n [ U 5 R 5 ( d M# [ U 5 R 5 PM> nn [ [ R U5 5 nSR U5 n
Un U
( a9 U
R 5 UR 5 ; a S U; a U SU
- -
n OU S U
- -
n [ UR R [ S5 5 n U ( a S
U S 3n
O6[ UR R [ S5 5 n U ( a S U S 3n
U ( aL U R 5 U R 5 ; a* SU ; a U R# S5 nU S U W
- XS - n OU W
-
n U " U R 5 X*=( d S S
9$ ! [ a` UR R SS5 nUR ( a/ SUR 5 ; a UR UR 5 GNf = fs sn f )Nr errorerrorsr z Content-Typer' htmlr r z (Request ID: r) z (Amzn Trace ID: )r server_message)r- r. appendjsonrz listextendr textlowerr0 stripdictfromkeysjoinr/ r, index)r r r
server_errors from_headersrw r r content_typeliner final_error_messagerI request_id_message
newline_indexs r= r r s M ##''(9:L \*0}}! %&& $$U+ $$U+(# %!((y)9: 4AV=4CIOODU&SY__&=MV }56M YY}-N )...08L8L8NN ^ # 4.#8 8 6N#: : X%%)),;z-Hz{0}: {1}zutf-8ignore)r readzi Nz ... [truncated]z-dr r' r( )r6 sortedr- itemsr formatbodyrz bytesdecodehasattrr3 r r7 r r r )r9 partskvr
flat_partss r= rC rC / sK
w~~ $E
w,,./ 779 'A
4**10122 0
|||| dE " ";;wx;8D
T6
"
"'D t9t ;!33D
4 dB/011 tW[[!
""EJ eAh ' 1 eAh ' 88J r? z%^\s*bytes\s*=\s*(\d*)\s*-\s*(\d*)\s*$original_range resume_sizec U ( d SU S3$ SU ; a [ SU < S35 e[ R U 5 nU( d [ SU < S35 eUR 5 u p4U( dB U( d [ SU < S35 e[ U5 U-
nSU 3nUS :: a [ S
U< S35 eU$ [ U5 nX1- nU( a* [ U5 nSU SU 3nXt: a [ S
U< S35 eU$ SU S3$ ) z:
Adjust HTTP Range header to account for resume position.
zbytes=-,zMultiple ranges detected - z, not supported yet.zInvalid range format - r zbytes=-r zEmpty new range - )
ValueError RANGE_REGEXmatch RuntimeErrorgroupsr| )r r r startend
new_suffix new_range new_starts r= _adjust_range_headerr [ s! }A&&
n 6~6HH\]^^ n -E 4^4FaHII JE !8 8J! LM MX +
j\* ? !3I= BC C JE#I
#h YKq. ? !3I= BC C
I;a r? )r@ N)N)Q__doc__r} rg reri r r1 functoolsr httpr shlexr typingr r r r r
r r rE r
r requests.adaptersr requests.modelsr huggingface_hub.errorsr r' r r r r r r r r r r _fixesr _lfsr _typingr
get_loggerrL r4 r, r/ compileVERBOSEr r# rS rX r\ BACKEND_FACTORY_Tr] __annotations__ra rk r` r| rf Timeoutr SERVICE_UNAVAILABLEr0 float Exceptionr r r r rC
IGNORECASEr r rK r? r= r s E D D D ( ) + 7 # "
H %
$
**
[ <
[
("2"2 R!1!1 12 -E * E AY !,= !]a !H \X%% \@* % % %@P@P % % P :D9W9W{8 {8 {8 {8
{8
{8 tId9os6J0K KL{8 !eCHo!56{8 {8|
x}
B?( B?8C= B?TX B?JGm^, Gmc GmX GmZh GmT% h.. % 3 % R jjA2==Q "!# "!S "!XVY] "!r?