a h@sddlmZddlmZddlmZmZmZmZddl m Z ddl m Z m Z mZmZmZmZddlmZddlmZedZGd d d e eeZGd d d eZd S))abstractmethod) defaultdict)AnyGenericOptionalTypeVar)override)_serialize_single_cache CacheArtifactCacheArtifactFactoryCacheArtifactManagerCacheArtifactsResult CacheInfo)AppendingByteSerializer) OrderedSetTc@sFeZdZdZeddddZeedddZee ddd Z dS) PrecompileCacheArtifacta5 Data for each cache artifact that will be serialized and deserialized by PrecompileContext, rather than CacheArtifactManager. T represents the deserialized type of the artifact, i.e. the return type of after_deserialization PrecompileCacheArtifact is a frozen dataclass - you can add new serializable fields and metadata specific to your own artifacts as needed, and use them in after_deserialization. Example implementation: class MyPrecompileCacheArtifact(PrecompileCacheArtifact[MySerializableType]): my_field: int def after_deserialization(self) -> MySerializableType: result = pickle.loads(self.content) # Do some extra work post deserialization result.my_post_deserialization_function(self.my_field) return result NreturncCs tddS)Nz1Precompile cache artifacts do not populate caches) RuntimeErrorselfrN/var/www/auris/lib/python3.9/site-packages/torch/_dynamo/precompile_context.pypopulate_cache.sz&PrecompileCacheArtifact.populate_cachecCsdS)NTrrrrrprecompile_compatible2sz-PrecompileCacheArtifact.precompile_compatiblecCsdS)z Code to be run after reading raw byte contents from disk. Generally converts self.content from raw bytes back into its original form. Nrrrrrafter_deserialization6sz-PrecompileCacheArtifact.after_deserialization) __name__ __module__ __qualname____doc__rrboolrrrrrrrrrsrcs eZdZUdZiZeeefed<e e Z e ed<e Ze eed<eedZeeee efed<eZeed<edd fd d Zeeeeedd d dZedd ddZeeeedddZeeeeefd fdd Zee edddZ edd ddZ!Z"S)PrecompileContexta PrecompileContext is a special CacheArtifactManager for handling precompilation It uses the same interface as CacheArtifactManager, but handles deserialization differently: instead of placing each artifact into respective caches, it will stitch all the cache artifacts for a single key together and place it into a global Precompile Cache. The following artifact types are supported by PrecompileContext: - BundledAOTAutogradCacheArtifact - CodeStateArtifact (from torch._dynamo.package once available) _new_cache_artifacts_by_key_new_cache_artifacts_seen_artifacts)Z serialize_fn _serializer _cache_infoNrcs|jtdSN)r#clearsupercls __class__rrr)]s zPrecompileContext.clear) artifact_typekeycontentrcCs6t|||}||jvrdS||j|<|j|dS)zg Called from each caching operation to record the artifact in this "mega" list N)r Z encode_creater%r#add)r,r/r0r1artifactrrrrecord_artifactbs   z!PrecompileContext.record_artifactcCs4|jD]}|j|j|q |jdS)z We normally record artifacts by key, but serialization expects them to be organized by artifact type. This function transfers artifacts from _new_cache_artifacts_by_key to _new_cache_artifacts N)r#valuesr$r.typeappendr))r,r3rrr_save_artifacts_by_typezsz)PrecompileContext._save_artifacts_by_type)r0rcCs|j|dS)zP Serialize all artifacts with the given key returned in a list. N)r#get)r,r0rrrserialize_artifact_by_keysz+PrecompileContext.serialize_artifact_by_keycs|tSr()r8r* serializer+r-rrr;szPrecompileContext.serialize) artifactsrcCs tddS)NZTODO)NotImplementedError)r<rrrpopulate_cachessz!PrecompileContext.populate_cachescCsddlm}dS)Nr)BundledAOTAutogradCacheArtifact)Z-torch._functorch._aot_autograd.autograd_cacher?)r,r?rrr"_ensure_cache_artifacts_registeredsz4PrecompileContext._ensure_cache_artifacts_registered)#rrrr r#dictstrr __annotations__rlistr$r rr%rr r&tuplerr' classmethodr)rrr4r8rr:bytesr; staticmethodr>r@ __classcell__rrr-rr"?s4   r"N)abcr collectionsrtypingrrrrZtyping_extensionsrZtorch.compiler._cacher r r r r rZ&torch.utils._appending_byte_serializerrZtorch.utils._ordered_setrrrr"rrrrs      &