a h@stdZddlmZddlmZmZmZddlZddlm Z ddlm Z gd Z ee e edfZed d d Zed d dZed ddZed ddZed ddZed ddZed ddZed ddZd1eddddZGdddZGd d!d!ZeZead2eedd"d#ZGd$d%d%eZeed&d'd(Z ed d)d*Z!eddd+d,Z"e d d-d.Z#ed d/d0Z$dS)3zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )AbstractContextManager)AnyOptionalUnionNdevice)amp) is_availableis_initialized synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventreturncCs tjjS)z/Returns a bool indicating if CPU supports AVX2.)torch_C_cpu_is_avx2_supportedrr@/var/www/auris/lib/python3.9/site-packages/torch/cpu/__init__.pyr!srcCs tjjS)z1Returns a bool indicating if CPU supports AVX512.)rrr_is_avx512_supportedrrrrr&srcCs tjjS)z6Returns a bool indicating if CPU supports AVX512_BF16.)rrr_is_avx512_bf16_supportedrrrrr+srcCs tjjS)z/Returns a bool indicating if CPU supports VNNI.)rrrZ_is_avx512_vnni_supportedrrrr_is_vnni_supported0sr cCs tjjS)z3Returns a bool indicating if CPU supports AMX_TILE.)rrr_is_amx_tile_supportedrrrrr!6sr!cCs tjjS)z3Returns a bool indicating if CPU supports AMX FP16.)rrr_is_amx_fp16_supportedrrrrr";sr"cCs tjjS)zInitializes AMX instructions.)rrr _init_amxrrrrr#@sr#cCsdS)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrrr Esr )rrcCsdS)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrrrrr Nsr c@sLeZdZdZdeddddZdddd Zddd d Zddd d ZdS)rzH N.B. This class only exists to facilitate device-agnostic code N)priorityrcCsdSNr)selfr%rrr__init__]szStream.__init__rcCsdSr&rr'rrrr wait_stream`szStream.wait_streamcCsdSr&rr'rrr record_eventcszStream.record_eventcCsdSr&r)r'eventrrr wait_eventfszStream.wait_event)r$) __name__ __module__ __qualname____doc__intr(r*r,r.rrrrrXs rc@sHeZdZedddZd ddddZddddZd ddd d ZdS) rrcCsdS)NTrr+rrrqueryksz Event.queryNcCsdSr&rr)rrrrecordnsz Event.recordcCsdSr&rr+rrrr qszEvent.synchronizecCsdSr&rr)rrrwaittsz Event.wait)N)N)r/r0r1boolr4r5r r6rrrrrjsrcCstS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrrrrr|s rc@sBeZdZUdZeeed<ddZddZe e e ddd d Z dS) rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code cur_streamcCs||_t|_dSr&)r_default_cpu_stream prev_streamr)rrrr(szStreamContext.__init__cCs |j}|durdSt|_|adSr&)rr8r;)r'r9rrr __enter__s zStreamContext.__enter__N)typevalue tracebackrcCs|j}|durdS|jadSr&)rr;r8)r'r=r>r?r9rrr__exit__szStreamContext.__exit__) r/r0r1r2rr__annotations__r(r<rr@rrrrrs   r)rrcCst|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rrrrrsrcCsdS)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrsrcCsdS)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code NrrrrrrsrcCsdS)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrsrcCsdS)zReturns True if the CPU is initialized. Always True. N.B. This function only exists to facilitate device-agnostic code Trrrrrr sr )N)N)%r2 contextlibrtypingrrrrrZ_devicer __all__strr3Z _device_tr7rrrr r!r"r#r r rrr:r8rrrrrrr rrrrs6