a hw @svddlmZddlmZmZmZmZmZddlm Z ddl Z ddl m Z m Z gdZe dedeed d d Zeed d d ZedeeeZede jeeee jfeee jdfdddZedeeeee jfeeedddZdddZdeedfeeeefeeee jfeeeedfeeeefdffdddZdeeee jfeedddZdS) )Sequence)AnyOptionaloverloadTypeVarUnion) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)category)objreturncCst|SN)_is_namedtuplerrN/var/www/auris/lib/python3.9/site-packages/torch/nn/parallel/scatter_gather.py is_namedtuple srcCst|tot|dot|dS)N_asdict_fields) isinstancetuplehasattrrrrrrsrT.)inputs target_gpusdimrcCsdSrrrrrrrrr !sr cCsdSrrr rrrr )scs,fddz|}Wdnd0|S)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. csttjrtdStr@fddttDSttrht dkrht ttStt rt dkrddttDStt rt dkṙfddtt DSfddDS)Ncsg|]}t|qSrtype).0argsrrr ;z0scatter..scatter_map..rcSsg|] }t|qSr)listr#irrrr%?r&csg|]}t|qSrr!r(rrrr%Ar&csg|]}qSrrr#_rrrr%Br&) rtorchTensorr applyrzipmaprlenr'dictitemsrr scatter_maprrrr57s  zscatter..scatter_mapNr)rrrresrr4rr 1s   )rkwargsrrrcCs|rt|||ng}|r$t|||ng}t|t|kr^|ddtt|t|Dn4t|t|kr|ddtt|t|Dt|t|fS)z+Scatter with support for kwargs dictionary.css|] }dVqdS)rNrr*rrr Zsz!scatter_kwargs..css|] }iVqdSrrr*rrrr8^s)r r1extendranger)rr7rrZscattered_inputsZscattered_kwargsrrrr Ps   r )outputs target_devicerrcs,fddz|}Wdnd0|S)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. csdttjr(tjgRSdur4dSttrxtfddDs\tdtfddDSt rt t t Stt t S)Nrc3s|]}tt|kVqdSr)r1r#d)outrrr8|r&z-gather..gather_map..z+All dicts must have the same number of keysc3s(|] fddDfVqdS)csg|] }|qSrrr=krrr%~r&z8gather..gather_map...Nr)r#) gather_mapr;r@rr8~r&) rr,r-r r.r2all ValueErrorr"r_maker0r/)r;rrBr<)r?r;rrBus  zgather..gather_mapNr)r;r<rr6rrFrr ds   r ).).)r)r)r)collections.abcrtypingrrrrrZtyping_extensionsrr,Ztorch.nn.parallel._functionsr r __all__ FutureWarningboolrrr2r'rrr-intZdevicer strr r rrrrsL    # "