JThVE%SrSSKrSSKrSSKJr SSKJrJrJrJ r SSK r SSK r SSK J r SSKJrJr SSKJr SS KJrJr S q\R."5r\R2"5r/q\\\/S4\\4\S '\ "\ RBS S 5r"\ \ \\#S4r$\"5q%Sr&\\ RBRN\S'S\(4Sjr)\)"5(aC\ RBRTr*\ RBRVr,\ RBRZr.O\"S5r*S\#S\#4Sjr,S\#S\#4Sjr.\"SS9S\#4Sj5r/S\(4Sjr0Sr1Sr2Sr3Sr4Sr5"SS5r6"S S5r "S!S"\ 5r7S\$SS4S#jr8S=S\\$S\4S$jjr9\"S5S=S\\$S\:\\44S%jj5r;S=S\\$S\*4S&jjr"S)S*5r?S+\S,S\?4S-jr@S.rAS+\4S/jrBS=S\\$S\4S0jjrCS=S1\#S\\$S\4S2jjrDS=S\$SS4S3jjrES\\4S4jrFS\4S5jrGS\ RS\ RBRN4S6jrHS>S7\#S\ \#\\ R4SS4S8jjrIS>S\ \#\\ R4S\#4S9jjrJSS:KKJLrLJMrMJNrNJOrOJPrPJQrQJRrRJSrSJTrTJUrU SS;KVJWrWJXrXJYrYJZrZJ[r[J\r\J]r]J^r^J_r_ /Srsrrdefault_generatorsreturnc6[RR$)z(Return true if compile with XPU support.)torch_C_has_xpurrr _is_compiledr#s 88  r_XpuDevicePropertiesr c[S5eNz(PyTorch was compiled without XPU supportNotImplementedErrorrs r_exchange_devicer$0!"LMMrc[S5er!r"rs r_maybe_exchange_devicer'3r%r)maxsizec^[5(dg[RR5$)z*Return the number of XPU device available.r)rrr_xpu_getDeviceCountrrr device_countr+7s! >> 88 ' ' ))rc[5S:$)z7Return a bool indicating if XPU is currently available.r)r+rrr is_availabler-?s >A rcg)zKReturn a bool indicating if the current XPU device supports dtype bfloat16.Trrrris_bf16_supportedr/Es rc:[=(a [5(+$)z8Return whether PyTorch's XPU state has been initialized.) _initialized_is_in_bad_forkrrris_initializedr3Js  1 111rc [5(aU"5 gURSS5(a*[RU[R "55 gURSS5(a*[R U[R "55 g[RU[R "545 g)Nseed_allFseed) r3get_lazy_seed_trackerqueue_seed_all traceback format_stack queue_seedrappend)callablekwargss r _lazy_callr@Os  ::j% ( (  - -h 8N8N8P Q ZZ & &  ) )(I4J4J4L M  (I,B,B,D!E Frc[5 g)zInitialize PyTorch's XPU state. This is a Python API about lazy initialization that avoids initializing XPU until the first time it is accessed. Does nothing if the XPU state is already initialized. N) _lazy_initrrrinitrC]s Lrc [5(d[[S5(ag[ [5(a SSS5 g[ 5(a [ S5e[ 5(d [S5e[RR5 S[l [RS[R555 [H upU"5 M ['[S5 SqSSS5 g![ a1nS[#U5SSR%U53n[!U5UeSnAff=f!['[S5 f=f!,(df  g=f) Nis_initializingzuCannot re-initialize XPU in forked subprocess. To use XPU with multiprocessing, you must use the 'spawn' start methodz#Torch not compiled with XPU enabledTc36# UHo(dM Uv M g7fNr).0callss r _lazy_init..}sX0NuRWUU0Ns  z5XPU call failed lazily at initialization with error: z' XPU call was originally invoked at: )r3hasattr_tls_initialization_lockr2 RuntimeErrorrAssertionErrorrr _xpu_initrErextendr8 get_calls Exceptionstrjoindelattrr1) queued_callorig_tracebackemsgs rrBrBfs=74):;;          I ~~ !FG G  $X0B0L0L0NXX -/<+ 0M0= D+ , C  2!0OPSTUPVxXBBD''.BYAZ\$C.a/ 0 D+ ,A  sNEB E ED%E)E D?,D::D??EEE E%c>\rSrSrS\4SjrSrS\S\S\4SjrS r g ) _DeviceGuardindexcXlSUlgNidxprev_idx)selfr`s r__init___DeviceGuard.__init__s rc`[RRUR5UlgrGrxpur$rerfrgs r __enter___DeviceGuard.__enter__ 22488< rtypevaluer:c`[RRUR5Ulgrrrlr'rfrergrqrrr:s r__exit___DeviceGuard.__exit__9933DMMBrrdN) __name__ __module__ __qualname____firstlineno__intrhrnrrv__static_attributes__rrrr^r^s-c=Srr^cB\rSrSrSrS\4SjrSrS\S\S\4SjrS r g ) r zContext-manager that changes the selected device. Args: device (torch.device or int or str): device index to select. It's a no-op if this argument is a negative integer or ``None``. c0[USS9UlSUlg)NToptionalrc)r rerf)rgr s rrhdevice.__init__s$Vd; rc`[RRUR5UlgrGrkrms rrndevice.__enter__rprrqrrr:c`[RRUR5Ulgrrtrus rrvdevice.__exit__rxrrdN) ryrzr{r|__doc__rrhrnrvr~rrrr r s2s=Src,^\rSrSrSrU4SjrSrU=r$) device_ofa Context-manager that changes the current device to that of given object. You can use both tensors and storages as arguments. If a given object is not allocated on a XPU, this is a no-op. Args: obj (Tensor or Storage): object allocated on the selected device. cj>UR(aUR5OSn[TU] U5 grb)is_xpu get_devicesuperrh)rgobjre __class__s rrhdevice_of.__init__s$"%**cnn" rr)ryrzr{r|rrhr~ __classcell__)rs@rrrsrrcz[5 [U5nUS:a [RR U5 gg)zSet the current device. Args: device (torch.device or int or str): selected device. This function is a no-op if this argument is negative. rN)rBr rr_xpu_setDevicers r set_devicers1L v &F { 'rc,[U5R$)amGet the name of a device. Args: device (torch.device or int or str, optional): device for which to return the name. This function is a no-op if this argument is a negative integer. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Returns: str: the name of the device )get_device_propertiesnamers rget_device_namers ! ( - --rc[U5n[U5Vs0sH'nURS5(aMU[X5_M) sn$s snf)aGet the xpu capability of a device. Args: device (torch.device or int or str, optional): device for which to return the device capability. This function is a no-op if this argument is a negative integer. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Returns: Dict[str, Any]: the xpu capability dictionary of the device )__ _pybind11_)rdir startswithgetattr)r propsprops rget_device_capabilityrsR "& )EJ D34 #ge""  s A A c@[5 [USS9n[U5$)zGet the properties of a device. Args: device (torch.device or int or str): device for which to return the properties of the device. Returns: _XpuDeviceProperties: the properties of the device Tr)rBr _get_device_propertiesrs rrrs L v 5F !& ))rcR[5 [RR5$)z0Return the index of a currently selected device.)rBrr_xpu_getDevicerrrcurrent_devicersL 88 " " $$rc[U[5(a[R"U5nU$[U[5(a[R"SU5nU$)zReturn the torch.device type object from the passed in device. Args: device (torch.device or int or str): selected device. rl) isinstancerVrr r}rs r _get_devicer sJ &#f% M FC eV, MrcZ\rSrSr%Sr\S\S'S\S4SjrSrS\ S \ S \ 4S jr S r g ) StreamContextiaContext-manager that selects a given stream. All XPU kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.xpu.Stream cur_streamstreamc\Xl[SS5UlURcSUlgg)NTrc)rr re)rgrs rrhStreamContext.__init__$s+ $T40 88 DH rcURnUbURS:Xag[RR S5UlUR R UR :waL[ UR 5 [RR UR 5UlSSS5 [RRU5 g!,(df  N.=frb) rrerrlcurrent_streamsrc_prev_streamr dst_prev_stream set_stream)rgrs rrnStreamContext.__enter__*s[[  R $yy77=    & &**;*; ; ))*',yy'?'? @Q@Q'R$+ Z(+*s >/C C#rqrrr:c0URnUbURS:XagURRUR:wa)[R R UR5 [R R UR5 grb)rrerr rrlrr)rgrqrrr:rs rrvStreamContext.__exit__6sj[[  R     & &**;*; ; II !5!5 6 T112r)rrerrN) ryrzr{r|rr__annotations__rhrnrrvr~rrrrrsF +,,x(:; )3S333rrrrc[U5$)zWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. )rrs rrrAs   rcB[RRUUUS9 g)zset stream specified by the stream id, device index and device type Args: stream_id (int): not visible to the user, used to assigned to the specific stream. device_index (int): selected device index. device_type (int): selected device type.  stream_id device_index device_typeN)rr_xpu_setStreamrs r_set_stream_by_idrJs$ HH!rcrUcg[5 [URURURS9 g)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. Nr)rBrrrrrs rrrXs4~L""((&&rc[5 [RR[ USS95n[ USUSUSS9$)a:Return the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Trrr r)rBrr_xpu_getCurrentStreamr r)r streamdatas rrrksJL//&40J Q-jmTU rdata_ptrc[5 [RRU[ USS95n[ USUSUSS9$)aReturn a :class:`Stream` from an external SYCL queue. This function is used to wrap SYCL queue created in other libraries in order to facilitate data exchange and multi-library interactions. .. note:: This function doesn't manage the queue life-cycle, it is the user responsibility to keep the referenced queue alive while this returned stream is being used. The different SYCL queue pointers will result in distinct :class:`Stream` objects, even if the SYCL queues they dereference are equivalent. Args: data_ptr(int): Integer representation of the `sycl::queue*` value passed externally. device(torch.device or int, optional): the device where the queue was originally created. It is the user responsibility to ensure the device is specified correctly. Trrr rr)rBrr_xpu_getStreamFromExternalr r)rr rs rget_stream_from_externalr}sM$L44#FT:J Q-jmTU rch[5 [USS9n[RR U5$)aWait for all kernels in all streams on a XPU device to complete. Args: device (torch.device or int, optional): device for which to synchronize. It uses the current device, given by :func:`~torch.xpu.current_device`, if :attr:`device` is ``None`` (default). Tr)rBr rr_xpu_synchronizers r synchronizers*L v 5F 88 $ $V ,,rc[5(d/$[RR5nUc/$UR 5$)z> ++-J    rcl[5n[U5S:XagSSRSU553$)zIReturn XPU AOT(ahead-of-time) build flags this library was compiled with.rrLz-device ,c3$# UHov M g7frGr)rHarchs rrJ$get_gencode_flags..s: t s)rlenrW) arch_lists rget_gencode_flagsrs5I 9~ chh: ::; <>[T5nURT5 grG)r set_offset)default_generator final_devicers rcb!_set_rng_state_offset..cbs*<8$$V,rN)rr@)rr rrs` @r_set_rng_state_offsetrsv&L-rNrcb[5 [U5n[U5nUR5$)a4Return the random number generator state offset of the specified GPU. Args: device (torch.device or int, optional): The device to return the RNG state offset of. Default: ``'xpu'`` (i.e., ``torch.device('xpu')``, the current XPU device). .. warning:: This function eagerly initializes XPU. )rBrr get_offset)r rrs r_get_rng_state_offsetrs-Lv&L&|4  ' ' ))r) empty_cachemax_memory_allocatedmax_memory_reserved mem_get_infomemory_allocatedmemory_reserved memory_statsmemory_stats_as_nested_dictreset_accumulated_memory_statsreset_peak_memory_stats) get_rng_stateget_rng_state_all initial_seed manual_seedmanual_seed_allr6r5 set_rng_stateset_rng_state_all)+rrrrrrr rr+rrrrrrrrrrCrr-r/r3rrrrrrrrrrrr6r5rrrrrstreamsrrG)rl)ar threadingr: functoolsrtypingrrrrrtorch._Cr _device torch._utilsr r _utilsr rrrr1localrNLockrOrlisttuplerVrrrr2r} _device_tr8r Generatorboolrr_xpu_exchangeDevicer$_xpu_maybeExchangeDevicer'r+r-r/r3r@rCrBr^rrrdictrrrrrrrrrrrrrrrrmemoryrrrrrrrrrrrandomrrrrrr6r5rr__all__rrrrs11 #6%"  ~~'t (2t8 d3i '(%(($6 F '3T) * %'02E%((,,-2d >> 8888xx33"XX>>''=>NNNNsNsN 1*c**d  2 G%P  (   (y (T ( .HY/ .3 . 4(9"5c3h4 *(9"5 *AU *%% c3 45 %,, '3'3T!8./!M! v&8I.&&26#I. 6 - -T -tCy=3= -5<< -EHH,>,> -:? sC56 & *%S%,,(>"? *C *"      , r