[Th' %SSKJrJr SSKrSSKrSSKrSSKJ r SSK J r SSK J r Jr SSKJrJrJr SS KJr 0q\\\ S \ \\\\444\S 'S S /rSrS\S\\\44SjrS\\\4S\4SjrS\S\S\\4Sjr S%S\S\S\4Sjjr!Sr"Sr#S\4Sjr$S\4Sjr%S&S\4Sjjr&\4S\S\ 4S jjr'\4S\S\ 4S!jjr(\"S"\'5 \"S#\(5 \"S$\$5 g!\ar\"S5\eSrCff=f)')urlparse urlunparsezEurllib cannot be found, urlparse from python2 is no longer supported.N)Iterator) timedelta)CallableOptional) FileStoreStoreTCPStore)default_pg_timeout._rendezvous_handlersregister_rendezvous_handler rendezvouscHU[;a[SUS35eU[U'g)a Register a new rendezvous handler. Before we can run collective algorithms, participating processes need to find each other and exchange information to be able to communicate. We call this process rendezvous. The outcome of the rendezvous process is a triplet containing a shared key/value store, the rank of the process, and the total number of participating processes. If none of the bundled rendezvous methods apply to your execution environment you can opt to register your own rendezvous handler. Pick a unique name and use the URL scheme to identify it when calling the `rendezvous()` function. Args: scheme (str): URL scheme to identify your rendezvous handler. handler (function): Handler that is invoked when the `rendezvous()` function is called with a URL that uses the corresponding scheme. It must be a generator function that yields the triplet. zRendezvous handler for z:// already registeredN)r RuntimeError)schemehandlers T/var/www/auris/envauris/lib/python3.13/site-packages/torch/distributed/rendezvous.pyrrs.2%%4VH!_query_to_dict..=sP1OZZ__1Os&rr )filterr)rrs r_query_to_dictr#:sLQekk#>N1OP PD QaP  s; query_dictc[RS:Xa3URS[RRSS55S:H$URS[RRSS55S:H$)Nwin32 use_libuv USE_LIBUV01)sysplatformgetosenviron)r$s r_get_use_libuv_from_query_dictr0As[ ||w~~k2::>>+s+KLPSSS >>+rzz~~k3'G HC OOrurlrankworld_size_optc [U5nUceSnURS:XaR[[RR SU55n[[RR SU55nOUnUS:wd US:wdUc[ UR5nSU;aSU;d SUS35eUS:wa[U5US'US:wdUc[U5US'URS RUR5VVs/sH upxUS U3PM snn5S 9n[U5nUR[;a[S URS 35e[UR"U40UD6$s snnf)NenvRANK WORLD_SIZEr2 world_sizez The url: z7 has node-specific arguments(rank, world_size) already.r!r)rzNo rendezvous handler for z://)rrintr.r/r-r#rstr_replacejoinitemsrrr) r1r2r3kwargsresultr9r$kvs r_rendezvous_helperrCJso c]F ==E !rzz~~fd34DRZZ^^L*EFJ#  rzZ2%)?#FLL1 Z'L ,J uS T J 2:!$TJv   ~5'*:J| $XXj6F6F6HI6Hda!AaSz6HIJK!   }}007 cJKK  .s =f == JsE5r9c :[U[[45(d[S[ U5SU35e[U[ R 5(d[SU35e[U[ R 5(d[SU35e[XU40UD6$)Nz`url` must be a string. z: z`rank` must be an integer. z!`world_size` must be an integer. ) isinstancer;bytesrtypenumbersIntegralrC)r1r2r9r?s rrrgs cC< ( (5d3i[3%HII dG,, - -8?@@ j'"2"2 3 3>zlKLL c >v >>rcN[[URUS55un nU$N)nextrC init_method)backend_optionsr2store_s r_create_store_from_optionsrQts')/*E*EtTRSKE1a Lrc[SU-5$)Nz+Error initializing torch.distributed using ) ValueErrormsgs r_rendezvous_errorrVys CcI JJrc+# Sn[U5nURn[RS:Xa^SSKnUR UR-nUR RU5nU(a[RRU5nU(dU"S5e[UR5nSU;aU"S5eSU;aU"S5e[US5n[US5n [XI5n XU 4v [S 5e7f) Nc[SU-5$)Nzfile:// rendezvous: rVrTs r_error(_file_rendezvous_handler.._error~s !7#!=>>rr&rz path missingr2rank parameter missingr9world size parameter missingz3Unable to perform rerendezvous using file:// method)rpathr+r,urllib.requestnetlocrequest url2pathnamer.normpathr#rr:r r) r1r?rZr@r^urllib full_pathr$r2r9rOs r_file_rendezvous_handlerrf}s?c]F ;;D ||wMMFKK/ ~~**95 77##D)D ^$$ -J Z-..:%344 z&! "DZ -.J d 'E  ## L MMsDDcZ[RRSS5[S5:H$)NTORCHELASTIC_USE_AGENT_STORET)r.r/r-r;rr_torchelastic_use_agent_storerjs! ::>>8$ ?3t9 LLrc SUs=::aS:dO [SUS35e[5(a [UUUSUS9$US:Hn[UUUUUSUS9$) aH Smartly creates a c10d Store object on ``rank`` based on whether we need to re-use agent store. The TCPStore server is assumed to be hosted on ``hostname:port``. By default, the TCPStore server uses the asynchronous implementation ``LibUVStoreDaemon`` which utilizes libuv. If ``torchelastic_use_agent_store()`` is ``True``, then it is assumed that the agent leader (node rank 0) hosts the TCPStore server (for which the endpoint is specified by the given ``hostname:port``). Hence ALL ranks will create and return a TCPStore client (e.g. ``start_daemon=False``). If ``torchelastic_use_agent_store()`` is ``False``, then rank 0 will host the TCPStore (with multi-tenancy) and it is assumed that rank 0's hostname and port are correctly passed via ``hostname`` and ``port``. All non-zero ranks will create and return a TCPStore client. riz-port must have value from 0 to 65535 but was .F) host_nameportr9 is_mastertimeoutT)rmrnr9rorp multi_tenantr')rSrjr )hostnamernr2r9rpr' start_daemons r_create_c10d_storertsx.  u HaPQQ$&&!   qy !"  rrpc+# Sn[U5nUR(dU"S5e[UR5nSU;aU"S5eSU;aU"S5e[ US5n[ US5n[ U5nUR ce[UR URXgX5n XU4v [S5e7f)Nc[SU-5$)Nztcp:// rendezvous: rYrTs rrZ'_tcp_rendezvous_handler.._error !6!<==rzport number missingr2r\r9r]z3Unable to perform re-rendezvous using tcp:// method) rrnr#rr:r0rrrtr) r1rpr?rZr@r$r2r9r'rOs r_tcp_rendezvous_handlerrys>c]F ;;*++ -J Z-..:%344 z&! "DZ -.J.z:I ?? && & d E  ## L MMsCCc+^ ^ # Sm U 4Sjm S[S[4U 4Sjjn[U5n[UR5nSU;a[ US5nO[ U"S55nSU;a[ US5nO[ U"S 55nU"S 5n[ U"S 55n [ U5n [ XXgX5n XU4v [S 5e7f) Nc[SU-5$)Nzenv:// rendezvous: rYrTs rrZ'_env_rendezvous_handler.._errorrxrc>T"SUS35$)Nzenvironment variable z expected, but not setri)varrZs r _env_error+_env_rendezvous_handler.._env_errors-cU2HIJJrenv_varrcf>[RRUS5nU(dT"U5eU$rK)r.r/r-)renv_valrs r_get_env_or_raise2_env_rendezvous_handler.._get_env_or_raises***..$/W% %Nrr2r7r9r8 MASTER_ADDR MASTER_PORTz3Unable to perform re-rendezvous using env:// method)r;rr#rr:r0rtr)r1rpr?rr@r$r2r9 master_addr master_portr'rOrrZs @@r_env_rendezvous_handlerrs>K33c]F -J:f%&$V,-z!L12 *<89 #M2K' 67K.z:I $G E  ## L MMsC Ctcpr6file)r5r5)T)) urllib.parserr ImportErrorerHr.r+collections.abcrdatetimertypingrrtorch.distributedr r r constantsr rdictr;tupler:__annotations____all__rr#boolr0rCrrQrVrfrjrtryrrirrrs 1  $%88)TVd3huUC_7M.N)N OOPU (, 7+@#$sCx.PtCH~P$P>C>s>HSM>: ?C ?s ?S ? KN#N@MtM :>-  - b$6N N N@$6-N -N -N`E#:;E#:;F$<=} O    sC$$C8* C33C8