o Zh+@s<ddlZddlZddlZddlmZddlmZmZmZddl m Z ddl Z ddl Z ddl mZddlmZeeZded ed efd d Zd ed efddZded eded eeeeeffddZd eee jffddZd eedffddZdede j d eeeffddZ!dedee j d eeeffddZ"deded eeeffdd Z#ded eeeffd!d"Z$de jd eeeffd#d$Z%de j&d eeeffd%d&Z'de j(d eeeffd'd(Z)ddd)d)d*ded ededed+edefd,eed-eeefd.eeeefd/eeeefd0ed1ed efd2d3Z*dS)4N)Path)AnyCallableOptional)mock) is_cpu_device) cache_dir namespacedevicereturncCsttd||S)NZ aoti_eager)rr )r r r I/var/www/auris/lib/python3.10/site-packages/torch/_inductor/aoti_eager.pyaoti_eager_cache_dirrop_func_name_with_overloadcCsBddlm}m}ddlm}|d}|}|tj|||dS)Nr) get_lock_dir LOCK_TIMEOUT)FileLockz.lock)timeout)Ztorch._inductor.codecacherrZtorch.utils._filelockrospathjoin)rrrrZop_conf_lock_fileZlock_dirr r raoti_eager_op_conf_locks   rns device_typec Cst||}||d}|sgSzt|t|}t|}|D]~}||d}||d<|sIgWdWdWS|dD]T} | drXtdd| vrf| ddkrfd| d <d D]} | | vr|t t | |  d d| | <qhd | vrt t | d  d d| d <d | vrt t | d  d d| d <qMq$|WdWdWS1swYWdWdS1swYWdSt y} zd| } t | gWYd} ~ Sd} ~ ww)N.json kernel_path meta_info is_dynamic!Only support static shape for nowrcpu device_index)dtype dtype_value. layout_valueZmemory_format_valuez!Failed to load aoti eager cache: )rexistsropenjsonloadas_posixgetNotImplementedErrorgetattrtorchsplit Exceptionlog exception) rrrZdevice_kernel_cacheop_conff json_dataitemZkernel_lib_abs_pathmetadataZ dtype_keyeerr_msgr r rload_aoti_eager_cache sd        &%  r<cCsttjttjttjiSN)intr0Zint32floatboolr r r r#supported_builtin_dtype_torch_dtypeTrrA.cCst}t|Sr=)rAtuplekeys)type_to_torch_dtyper r rsupported_scalar_typesXs rEdynamicinputcCsi}||d<t|tjsJ|jj|d<t|grd|d<n|jj|d<|j|d<t| |d<t| |d<|j |d<tj ||d <|S) Nrrr"r#r$sizesstrides requires_gradZdispatch_key_set) isinstancer0Tensorr typerindexr$listsizeZstriderJZ_CZ_dispatch_keysZraw_repr)rFrGr9r r rextract_tensor_metadata]s     rQcCs>g}|D]}t|tjsJ|t||qi}||d<|S)NZ tensor_list)rKr0rLappendrQ)rFrGZ metadata_listr8r9r r rextract_tensor_list_metadataosrScCs\t|tsJi}d|d<||d<|dkrdnd|d<t}|t||d<||d <|S) NFrrr!r"rr#r$Z scalar_value)rKrErArM)rrGr9rDr r rextract_scalar_metadata}srTcCst|tsJi}||d<|S)NZ string_value)rKstrrGr9r r rextract_string_metadatasrWcC"t|tjsJi}||d<|S)Nr%)rKr0r$rVr r rextract_dtype_metadata rYcCs.t|tjsJi}|j|d<|j|d<|S)NZdevice_type_valueZdevice_index_value)rKr0r rMrNrVr r rextract_device_metadatas   r[cCrX)Nr')rKr0layoutrVr r rextract_layout_metadatarZr]F)dynamic_shapesoptionsremove_runtime_assertionsdisable_constraint_solverr6argskwargsr^r_r`rac Cs|rJdt|t|} tdd| Ds'd| } t| t| | D]} t| trGtdd| DsGd| } t| t| q)t||}|sW|j dd|d }|sc| t j t jd |iiz?tjj||||| | d d }t|tsJg}t| D]o\}} t| tjrt|| }nVt| trtd d| DsJt|| }n@t| trt|| }n4t| trt| }n*t| tjrt| }nt| tjrt| }nt| tj rt!| }n tdt"| ||d<|#|qi}||d<t$|%||d<g}d}||d}|r"dnd}t&|yt'||=}zt()|}Wn t*yBg}Ynwt|tsKJ|D]}t|t sWJ|d|krbd }nqMWdn 1sowY|r|#|t'|d}t(j+||ddWdn 1swYWdn 1swY|WWdSt*y}zd|d|} t| WYd}~WddSd}~ww1swYdS)zO Compile the given function with persistent cache for AOTI eager mode. r c ss2|]}t|ttjtttjtjtjfVqdSr=) rKrEr0rLrOrUr$r r\).0rGr r r s  z5aoti_compile_with_persistent_cache..zUnsupported input types: cs|] }t|tjVqdSr=rKr0rLrdr8r r rres  z<_impl_with_aoti_compile encounters unsupported input types: T)parentslibZTORCHINDUCTOR_CACHE_DIRF)r^r`raZsame_signaturecsrfr=rgrhr r rreszUnsupported input type: Z arg_orderrrrrwN)indentzFailed to compile z: ),rOvaluesallr3r4r.rKrr(mkdirrpatchdictrenvironabsoluter,r0Z_exportZ aot_compilerU enumeraterLrQrSrErTrWr$rYr r[r\r]rMrRr relative_torr)r*r+r2dump)rrrrFr6rbrcr^r_r`raZflattened_inputsr;rGZpersistent_cacheZpersistent_cache_libZkernel_lib_pathZkernel_metadata_itemsidxr9Zkernel_meta_infor7Z update_jsonr5modeZ op_conf_filer8r:r r r"aoti_compile_with_persistent_caches                            J  Jr|)+r*loggingrpathlibrtypingrrrZunittestrr0Z torch._exportZtorch._inductor.utilsrZruntime.runtime_utilsr getLogger__name__r3rUrrrOrtr<rMr$rArBrEr@rLrQrSrTrWrYr r[r\r]r|r r r rs       4