[Th bSSKrSSKJr SSKJr SSKrSSKJr \R"\5r Sr Sr "SS\ 5r S rS \\\R \\R S 44S \\\R \\R S 444S jrSS\S\S\S\\\44Sjjr\"SS55rg)N) dataclass)Union)fxc\^/mU4Sjn[RRUU5nUT4$)zT Flatten the args into a list form and detach the tensors from computational graph. c>[U[R5(a<UR5R UR 5nTR U5 U$TR U5 U$N) isinstancetorchTensordetachrequires_grad_ requires_gradappend)avalflat_detached_argss [/var/www/auris/envauris/lib/python3.13/site-packages/torch/distributed/pipelining/_utils.pyextract_tensor_args0flatten_args_detach..extract_tensor_argssT a & &((*++AOOTRU5 U$r)r)r flat_argss rr)flatten_args..extract_tensor_args,srr)rrrs @r flatten_argsr!&s1I GG  rc\rSrSrSrSrg)PipeliningShapeError9z5Shape mismatch between configured and runtime values.N)__name__ __module__ __qualname____firstlineno____doc____static_attributes__r%rrr#r#9s?rr#cURUR:Xd'[USURSUR35eURUR:Xd'[USURSUR35eUR5UR5:Xd/[USUR5SUR535eg)Nz has a shape mismatch: expected z actual z has a dtype mismatch: expected z! has a stride mismatch: expected )shaper#dtypestride)descexpectedgivens rvalidate_tensor_metadatar3=s >>U[[ ("f4X^^4DHU[[M Z   >>U[[ ("f4X^^4DHU[[M Z   ??   ."f5hoo6G5HQVQ]Q]Q_P` a   /rexpected_tensors.actual_tensorsc [U5[U5:wa&[US[U5S[U5S35e[[U55Hn[USU3XX#5 M g)Nz: Number of values (z") does not match expected number ()z: value )lenr#ranger3)r0r4r5is rvalidate_tensors_metadatar;Ls  N 33"f(^)<(==_`cdt`u_vvw x  3'( ) fHQC "2"5~7H *rpp_size num_stagesstylereturnc"0nUS:Xa[U5H nX@-X4'M U$US:XaYX-S:wa[SUSUS35eSn[U5H,nXSU'US-U-S:XaMX@-S-S:XaUS- nM'US-nM. U$[S US 35e) z Compute the stage id to rank mapping for either a looped or V-style schedule. Most commonly num_stages == pp_size * 2, but this function can be used to compute the mapping for any number of stages per rank. loopvrz num_stages z% must be evenly divisible by pp_size z for V scheduleszStyle z is not supported.)r9 ValueError)r<r=r>mapping stage_index rank_indexs rgenerate_stage_to_rank_mappingrI[sG  ,K#.#8G -( N% #  1 $j\)NwiWgh   ,K#-K a7*a/&!+q0a a - N6%(:;<r]s!    8 $(0&@<@    D.ellC6G0HHI  $u||,eELL#4E.FFG  17 !*- #s(^D     r