JTh/ R%SrSSKrSSKrSSKJrJrJrJr SSKrSSKJ r J r SSK J r JrJr SSKJr SSKJr \\ \\4r\R.r\R0rS q/q\\\/S4\\4\S '\R<"5r\R@"5r!\"5r"S r#S r$S \%4Sjr&S.Sjr'"SS\(5r)S \%4Sjr*S \%4Sjr+S/S\\S S4Sjjr,S \4Sjr-S \4Sjr.S/S\\S \4Sjjr/S/S\\S \4Sjjr0S0S\\S\S\S S4Sjjr1S \2\\44Sjr3S/S\\S \\\44Sjjr4S.S jr5S!\4S"jr6S\S S4S#jr7"S$S5r "S%S&5r8S!\S'S \84S(jr9S1S\\\\R4S \ 4S)jjr:S1S*\ S\\\\R4S S4S+jjr;SS,K<7 /S-Qr=g)2zH This package enables an interface for accessing MTIA backend in python N)AnyCallableOptionalUnion)deviceTensor) _dummy_type_LazySeedTracker classproperty)Device)_get_device_indexF _queued_callsc[5 gN) _lazy_initK/var/www/auris/envauris/lib/python3.13/site-packages/torch/mtia/__init__.pyinitr!sLrc:[=(a [5(+$)z9Return whether PyTorch's MTIA state has been initialized.) _initialized_is_in_bad_forkrrris_initializedr%s  1 111rreturnc>[RR5$r)torch_C_mtia_isInBadForkrrrrr*s 88 % % ''rc [5(d[[S5(ag[ [5(a SSS5 g[ 5(a [ S5e[ 5(d [S5e[RR5 S[l [RS[R555 [H upU"5 M [)[S5 SqSSS5 g![ a1nS[#U5SSR%U53n['U5UeSnAff=f![)[S5 f=f!,(df  g=f) Nis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tc36# UHo(dM Uv M g7frr).0callss r _lazy_init..PsX0NuRWUU0Ns  z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: )rhasattr_tls_initialization_lockr RuntimeError _is_compiledAssertionErrorrr _mtia_initr!rextend_lazy_seed_tracker get_calls ExceptionstrjoinDeferredMtiaCallErrordelattrr) queued_callorig_tracebackemsgs rrr.sH74):;;          I ~~ *   $X0B0L0L0NXX -/<+ <M0= D+ , Y  H!<PQTUVQWPXYCCE77>CZB[]04!; < D+ ,W  sNEB E ED%E)E D?,D::D??EEE E%c\rSrSrSrg)r5arN)__name__ __module__ __qualname____firstlineno____static_attributes__rrrr5r5asrr5c>[RR5$)z*Return true if compiled with MTIA support.)rr _mtia_isBuiltrrrr,r,es 88 ! ! ##rc<[5(dg[5S:$)z'Return true if MTIA device is availableFr)r, device_countrrr is_availablerFjs >> >A rrc[RRU5 [RR 5sSSS5 $!,(df  g=f)z?Waits for all jobs in all streams on a MTIA device to complete.N)rmtiarr_mtia_deviceSynchronizers r synchronizerKrs0   6 "xx//1 # " "s A Ac>[RR5$)z,Return the number of MTIA devices available.)rr_mtia_getDeviceCountrrrrErEx 88 ( ( **rc>[RR5$)z0Return the index of a currently selected device.)rr%_accelerator_hooks_get_current_devicerrrcurrent_devicerQ~s 88 9 9 ;;rcP[RR[USS95$)a;Return the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Toptional)rr_mtia_getCurrentStreamrrJs rcurrent_streamrV! 88 * *+[RR5$)z4Return a dictionary of MTIA memory allocator history)rr_mtia_memorySnapshotrrrsnapshotrcrNrcP[RR[USS95$)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). TrS)rr_mtia_getDeviceCapabilityrrJs rget_device_capabilityrfs" 88 - -.?QU.V WWrc>[RR5$)zEmpty the MTIA device cache.)rr_mtia_emptyCacherrr empty_cacheris 88 $ $ &&rstreamcJUcg[RRU5 g)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)rr_mtia_setCurrentStreamrjs r set_streamrns~ HH##F+rcf[U5nUS:a [RRU5 gg)zSet the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)rrr%_accelerator_hooks_set_current_devicerJs r set_devicerqs,v &F { 66v>rcB\rSrSrSrS\4SjrSrS\S\S\4SjrS r g ) rzContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. c0[USS9UlSUlg)NTrS)ridxprev_idx)selfrs r__init__device.__init__s$Vd; rc`[RRUR5Ulgr)rr(_accelerator_hooks_maybe_exchange_devicervrw)rxs r __enter__device.__enter__sII$((S rtypevalue tracebackc`[RRUR5Ulg)NF)rrr|rwrv)rxrrrs r__exit__device.__exit__s88DDT]]Sr)rvrwN) r=r>r?r@__doc__rryr}rrArrrrrs3sTSrcZ\rSrSr%Sr\S\S'S\S4SjrSrS\ S \ S \ 4S jr S r g ) StreamContextaContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. torch.mtia.Stream cur_streamrjcSUlXl[SS5Ul[R R 5(dURcSUl[R R 5(dSO[RRS5Ul [R R 5(dSUl g[RRS5Ul g)NTru) rrjrrvrjit is_scriptingrHrZsrc_prev_streamdst_prev_stream)rxrjs rryStreamContext.__init__s $T40yy%%''xx ..00Dejj6O6OPT6U  ..00D 6;jj6O6OPT6U rcURnUbURS:Xag[RR S5UlUR R UR :waL[ UR 5 [RR UR 5UlSSS5 [RRU5 g!,(df  N.=fNru) rjrvrrHrVrrrrn)rxrs rr}StreamContext.__enter__s[[  R $zz88>    & &**;*; ; ))*',zz'@'@ARAR'S$+ j)+*s >/C C#rrrc0URnUbURS:XagURRUR:wa)[R R UR5 [R R UR5 gr)rjrvrrrrHrnr)rxrrrrs rrStreamContext.__exit__sj[[  R     & &**;*; ; JJ ! !$"6"6 7 d223r)rrrvrrjN) r=r>r?r@rr__annotations__ryr}rrrArrrrrsF ,--  x(;<   * 4S 4 4 4rrrc[U5$)aWrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rrms rrjrj,s   rc[R"S[SS9 [R"S/[R US9$)zReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.get_rng_state is not implemented in torch.mtia stacklevelr )dtyper)warningswarn UserWarningrzerosuint8rJs r get_rng_stater7s4 MM8 ;;s%++f ==r new_statec8[R"S[SS9 g)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.set_rng_state is not implemented in torch.mtiarrN)rrr)rrs r set_rng_staterFs MM8r)*)rrFrrKrErQrVrZ memory_statsmax_memory_allocatedreset_peak_memory_statsrfr`rcrirqrnrjrrr)rNr)allpythonr)rH)>r threadingrtypingrrrrrr_devicer torch._utilsr r r torch.typesr _utilsrr3int _device_tEventStreamrrlisttuplerlocalr)Lockr*r0rrboolrrr2r5r,rFrKrErQrVrZr`dictrcrfrirnrqrrjrrmemory__all__rrrrsq11 +EE% '3# $     t (2t8 d3i '( ~~'%'2 ((0f I $d$ d2+2t2 +c+ << U8I. U& U U8I. U& UPQE c]E,/EILE E&+$sCx.+ X(9"5XsCxX' ,v , ?y ?T ?(7474t!8/0!]! >%S%,, 67 >V > @F$S#u||%;< " r