o wZh@sddlmZddlmZmZmZmZmZddlm Z ddl Z ddl m Z m Z gdZe dedd ed efd d Zd ed efd dZedeeeZe dde jdeeee jfded ee jdffddZe ddedeeee jfded eefddZd ddZ d deedfdeeeefdeeee jfded eeedfeeeefdfff ddZd dedeee jfded efddZdS)!)Sequence)AnyOptionaloverloadTypeVarUnion) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)categoryobjreturncCst|SN)_is_namedtuplerrO/var/www/auris/lib/python3.10/site-packages/torch/nn/parallel/scatter_gather.py is_namedtuple srcCst|tot|dot|dS)N_asdict_fields) isinstancetuplehasattrrrrrrsrT.inputs target_gpusdimcCdSrrrrrrrrr !r cCr rrr!rrrr *r"c*fddz |}Wd|Sdw)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. csttjrtdStr fddttDSttr4t dkr4t ttStt rKt dkrKddttDStt rft dkrffddtt DSfddDS)Ncsg|]}t|qSrtype).0argsrrr =z0scatter..scatter_map..rcSsg|]}t|qSr)listr&irrrr(Acsg|]}t|qSrr$r+rrrr(Cr)csg|]}qSrrr&_rrrr(Ds) rtorchTensorr applyrzipmaprlenr*dictitemsrr scatter_maprrrr99s  zscatter..scatter_mapNr)rrrresrr8rr 3s  kwargscCs|rt|||ng}|rt|||ng}t|t|kr/|ddtt|t|Dnt|t|krI|ddtt|t|Dt|t|fS)z+Scatter with support for kwargs dictionary.css|]}dVqdS)rNrr.rrr \ z!scatter_kwargs..css|]}iVqdSrrr.rrrr<`r=)r r5extendranger)rr;rrZscattered_inputsZscattered_kwargsrrrr Rs   r outputs target_devicecr#)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. csdttjrtjgRSdurdSttr.gather_map..z+All dicts must have the same number of keysc3s*|]fddDfVqdS)csg|]}|qSrrrBkrrr(r-z8gather..gather_map...Nr)r&) gather_mapr@rErr<s() rr0r1r r2r6all ValueErrorr%r_maker4r3)r@rrGrA)rDr@rrGws  zgather..gather_mapNr)r@rArr:rrKrr fs  r ).)r)collections.abcrtypingrrrrrZtyping_extensionsrr0Ztorch.nn.parallel._functionsr r __all__ FutureWarningboolrrr6r*rrr1intZdevicer strr r rrrrsb     # " *