o wZŽh‡/ã @sUdZddlZddlZddlmZmZmZmZddlZddlm Z mZddlm Z mZmZddlmZddlmZee eefZejZejZd agaeeegdfeefed <e ¡Ze ¡Z!eƒZ"dd„Z#d d„Z$de%fdd„Z&dDdd„Z'Gdd„de(ƒZ)de%fdd„Z*de%fdd„Z+dEdeeddfdd„Z,defdd„Z-defdd „Z.dEdeedefd!d"„Z/dEdeedefd#d$„Z0 dFd'eed(ed)eddfd*d+„Z1de2eeffd,d-„Z3dEdeedeeeffd.d/„Z4dDd0d1„Z5d2efd3d4„Z6deddfd5d6„Z7Gd7d„dƒZ Gd8d9„d9ƒZ8d2ed:de8fd;d2„Z9dGdeeeej fdefd=d>„Z: tye}zdt|ƒ›dd |¡›}t|ƒ|‚d}~wwWttdƒnttdƒwdaWdƒdS1s€wYdS) NÚis_initializingzwCannot re-initialize MTIA in forked subprocess. To use MTIA with multiprocessing, you must use the 'spawn' start methodzÖTorch not compiled with MTIA enabled. Ensure you have `import mtia.host_runtime.torch_mtia.dynamic_library` in your python src file and include `//mtia/host_runtime/torch_mtia:torch_mtia` as your target dependency!Tcss|]}|r|VqdSrr)Ú.0ZcallsrrrÚ Ps€z_lazy_init..z6MTIA call failed lazily at initialization with error: z( MTIA call was originally invoked at: Ú)rÚhasattrÚ_tlsÚ_initialization_lockrÚRuntimeErrorÚ_is_compiledÚAssertionErrorrrZ _mtia_initrrÚextendÚ_lazy_seed_trackerZ get_callsÚ ExceptionÚstrÚjoinÚDeferredMtiaCallErrorÚdelattrr)Zqueued_callZorig_tracebackÚeÚmsgrrrr.sBùÿÿ ÿÿ €ûý "Ôrc@seZdZdS)r+N)Ú__name__Ú __module__Ú__qualname__rrrrr+asr+cCr)z*Return true if compiled with MTIA support.)rrZ _mtia_isBuiltrrrrr$eó r$cCstƒsdStƒdkS)z'Return true if MTIA device is availableFr)r$Údevice_countrrrrÚis_availablejs r4rcCs:tj |¡ tj ¡WdƒS1swYdS)z?Waits for all jobs in all streams on a MTIA device to complete.N)rÚmtiarrZ_mtia_deviceSynchronize©rrrrÚsynchronizers$ÿr7cCr)z,Return the number of MTIA devices available.)rrZ_mtia_getDeviceCountrrrrr3xó r3cCr)z0Return the index of a currently selected device.)rrZ%_accelerator_hooks_get_current_devicerrrrÚcurrent_device~r2r9cCótj t|dd¡S)aSReturn the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the currently selected :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). T©Úoptional)rrZ_mtia_getCurrentStreamr r6rrrÚcurrent_streamƒó r=cCr:)a=Return the default :class:`Stream` for a given device. Args: device (torch.device or int, optional): selected device. Returns the default :class:`Stream` for the current device, given by :func:`~torch.mtia.current_device`, if :attr:`device` is ``None`` (default). Tr;)rrZ_mtia_getDefaultStreamr r6rrrÚdefault_streamr>r?ÚallÚpythonÚenabledÚstacksÚmax_entriescCstƒsdStj |||¡dS)a•Enable/Disable the memory profiler on MTIA allocator Args: enabled (all or state, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). stacks ("python" or "cpp", optional). Select the stack trace to record. max_entries (int, optional). Maximum number of entries to record. N)rrrZ_mtia_recordMemoryHistory)rBrCrDrrrÚrecord_memory_history›srEcCr)z4Return a dictionary of MTIA memory allocator history)rrZ_mtia_memorySnapshotrrrrÚsnapshot®r8rFcCr:)aReturn capability of a given device as a tuple of (major version, minor version). Args: device (torch.device or int, optional) selected device. Returns statistics for the current device, given by current_device(), if device is None (default). Tr;)rrZ_mtia_getDeviceCapabilityr r6rrrÚget_device_capability´srGcCr)zEmpty the MTIA device cache.)rrZ_mtia_emptyCacherrrrÚempty_cache¿r2rHÚstreamcCs|durdStj |¡dS)aSet the current stream.This is a wrapper API to set the stream. Usage of this function is discouraged in favor of the ``stream`` context manager. Args: stream (Stream): selected stream. This function is a no-op if this argument is ``None``. N)rrZ_mtia_setCurrentStream©rIrrrÚ set_streamÄs rKcCs$t|ƒ}|dkrtj |¡dSdS)z¡Set the current device. Args: device (torch.device or int): selected device. This function is a no-op if this argument is negative. rN)r rrZ%_accelerator_hooks_set_current_devicer6rrrÚ set_deviceÒsÿrLc@s<eZdZdZdefdd„Zdd„Zdededefd d „ZdS)rzÌContext-manager that changes the selected device. Args: device (torch.device or int): device index to select. It's a no-op if this argument is a negative integer or ``None``. cCst|dd|_d|_dS)NTr;éÿÿÿÿ)r ÚidxÚprev_idx)ÚselfrrrrÚ__init__æs zdevice.__init__cCstj |j¡|_dSr)rrÚ(_accelerator_hooks_maybe_exchange_devicerNrO)rPrrrÚ __enter__êszdevice.__enter__ÚtypeÚvalueÚ tracebackcCstj |j¡|_dS)NF)rrrRrOrN)rPrTrUrVrrrÚ__exit__íszdevice.__exit__N)r/r0r1Ú__doc__rrQrSrWrrrrrÞs c@sNeZdZUdZeded<dedfdd„Zdd„Zd ed edefdd „Z dS)Ú StreamContextaContext-manager that selects a given stream. All MTIA kernels queued within its context will be enqueued on a selected stream. Args: Stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: Streams are per-device. útorch.mtia.StreamÚ cur_streamrIcCstd|_||_tddƒ|_tj ¡s|jdurd|_tj ¡s dntj d¡|_ tj ¡s1d|_ dStj d¡|_ dS)NTrM)r[rIr rNrZjitZis_scriptingr5r?Úsrc_prev_streamÚdst_prev_stream)rPrIrrrrQs ÿÿ ÿzStreamContext.__init__cCs‚|j}|dus|jdkrdStj d¡|_|jj|jkr9t|jƒtj |j¡|_Wdƒn1s4wYtj |¡dS©NrM) rIrNrr5r=r\rr]rK)rPr[rrrrSsÿzStreamContext.__enter__rTrUrVcCsJ|j}|dus|jdkrdS|jj|jkrtj |j¡tj |j¡dSr^)rIrNr\rrr5rKr])rPrTrUrVr[rrrrWszStreamContext.__exit__N) r/r0r1rXrÚ__annotations__rQrSrrWrrrrrYòs rYrZcCst|ƒS)a,Wrap around the Context-manager StreamContext that selects a given stream. Arguments: stream (Stream): selected stream. This manager is a no-op if it's ``None``. .. note:: In eager mode stream is of type Stream class while in JIT it doesn't support torch.mtia.stream )rYrJrrrrI,sr5cCs$tjdtddtjdgtj|dS)züReturns the random number generator state as a ByteTensor. Args: device (torch.device or int, optional): The device to return the RNG state of. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.get_rng_state is not implemented in torch.mtiaé©Ú stacklevelr)Zdtyper)ÚwarningsÚwarnÚUserWarningrZzerosZuint8r6rrrÚ get_rng_state7sýrfÚ new_statecCstjdtdddS)aSets the random number generator state. Args: new_state (torch.ByteTensor): The desired state device (torch.device or int, optional): The device to set the RNG state. Default: ``'mtia'`` (i.e., ``torch.device('mtia')``, the current mtia device). z.set_rng_state is not implemented in torch.mtiar`raN)rcrdre)rgrrrrÚ set_rng_stateFs ýrh)Ú*)rr4rr7r3r9r=r?Zmemory_statsZmax_memory_allocatedZreset_peak_memory_statsrGrErFrHrLrKrIrrhrf)rNr)r@rAr)r5)>rXÚ threadingrcÚtypingrrrrrrZ_devicerZtorch._utilsrr r Ztorch.typesrÚ_utilsr r)ÚintZ _device_tÚEventZStreamrrÚlistÚtupler_Úlocalr!ÚLockr"r'rrÚboolrrr(r+r$r4r7r3r9r=r?rEÚdictrFrGrHrKrLrYrIrfrhZmemoryÚ__all__rrrrÚszþÿ 3 ÿÿÿÿ þ : ÿÿÿ þ