JTh ~SSKrSSKrSSKJrJr SSKJr SSKrSSKJ r J r SSK J r J r Jr /SQrS\ S\\ 4S jrS\ S \\S\\ 4S jrS \ S\4S jr\ R.4S \ S\S\S\ 4SjjrS \ S\4SjrSS \ S\\S\ 4Sjjr\"S\S9S \ S\S\ 4Sj5rS \ S\4SjrS \ S\R<S\ 4Sjrg)N)AnyOptional) deprecated)_ShardingIterDataPipeSHARDING_PRIORITIES)DataPipe DataPipeGraph traverse_dps)apply_random_seedapply_shardingapply_shuffle_seedapply_shuffle_settingsget_all_graph_pipesgraphreturnc*[U[55$N)_get_all_graph_pipes_helperset)rs W/var/www/auris/envauris/lib/python3.13/site-packages/torch/utils/data/graph_settings.pyrrs &uce 44id_cachec/nUR5HKunupEX1;aMURU5 URU5 UR[ XQ55 MM U$r)itemsaddappendextendr)rrresultsdp_iddatapipe sub_graphs rrrs[!G(- $$    Ux 29GH )6 Nrr c[U[5=(d3 [US5=(a [R"UR 5$)Nr ) isinstancerhasattrinspectismethodr r s r_is_sharding_datapiper()s; h 5 6 *+ 6   X44 5rnum_of_instances instance_idcJ^^^^[U5nSUUUU4SjjmT"U5 U$)z Apply dynamic sharding over the ``sharding_filter`` DataPipe that has a method ``apply_sharding``. RuntimeError will be raised when multiple ``sharding_filter`` are presented in the same branch. c\>UR5Hup#Sn[U5(asUb[SUSU35e[R"UR 5n[ UR5S:aUR TT5 OUR TTT S9 UnUcUnT"X45 M g)NzoSharding twice on a single pipeline is likely unintended and will cause data loss. Sharding already applied to z while trying to apply to )sharding_group)valuesr( RuntimeErrorr% signaturer len parameters) r prev_applieddpr!appliedsig_helperr*r)r.s rr8apply_sharding.._helper=s"\\^MBG$R((+&77CnD^_a^bd ''(9(9:s~~&*%%&6 D%%(+n&& I '',rr)r )r r)r*r.rr8s ``` @rr r 0s'  "E((, EN Orc[US5=(aZ [US5=(aG [R"UR5=(a [R"UR5$)N set_shuffleset_seed)r$r%r&r;r<r's r_is_shuffle_datapiper=XsT-( 0 Hj ) 0   X11 2 0   X.. / rshufflec0UcU$[U5n[U5nUVs/sHn[U5(dMUPM nnU(d0U(a)[R"S5 UR 5nU/nUHnUR U5 M U$s snf)a) Traverse the graph of ``DataPipes`` to find and set shuffle attribute. Apply the method to each `DataPipe` that has APIs of ``set_shuffle`` and ``set_seed``. Args: datapipe: DataPipe that needs to set shuffle attribute shuffle: Shuffle option (default: ``None`` and no-op to the graph) z`shuffle=True` was set, but the datapipe does not contain a `Shuffler`. Adding one at the end. Be aware that the default buffer size might not be sufficient for your task.)r rr=warningswarnr>r;)r r>r all_pipespipe shufflersshufflers rrras  "E#E*I"+J)$/CD/I)IJ   [ ##%  W% OKs BBz`apply_shuffle_seed` is deprecated since 1.12 and will be removed in the future releases. Please use `apply_random_seed` instead.)categoryrngc[X5$r)r )r rGs rr r s X ++rch[US5=(a [R"UR5$)Nr<)r$r%r&r<r's r_is_random_datapiperJs% 8Z ( PW-=-=h>O>O-PPrc[U5n[U5n[5n/nUHQn[U5U;aM[ U5(dM&UR U5 UR [U55 MS UH[n[[R"S[RS9RUS9R55nURU5 M] U$)a Traverse the graph of ``DataPipes`` to find random ``DataPipe`` with an API of ``set_seed``. Then set the random seed based on the provided RNG to those ``DataPipe``. Args: datapipe: DataPipe that needs to set randomness rng: Random number generator to generate random seeds )dtype) generator)r rridrJrrinttorchemptyint64random_itemr<)r rGrrBcacherandom_datapipesrC random_seeds rr r s  "E#E*I EE d8u   t $ $  # #D ) IIbh  ! KK%++ . 6 6 6 E J J L  k" ! Orr) r%r@typingrrtyping_extensionsrrQ(torch.utils.data.datapipes.iter.shardingrrtorch.utils.data.graphrr r __all__listrrrPrboolr(DEFAULTr r=r FutureWarningr rJ Generatorr rLrrrcsQ ( IH 5}5h5   $'H  (^ H'.. %%%%  %P837  !)$   F .  ,,,,  ,Q(QtQu8r