o Zh@sUdZddlZddlZddlmZddlmZmZmZddl m Z GdddZ ee e e eefeeeeegdfZe ed<Gd d d ZGd d d ZdS) a[Metrics collection and management system for Dynamo. This module provides context managers for gathering and reporting metrics during compilation and runtime. It includes two main components: - MetricsContext: A context manager for collecting metrics during compilation, supporting nested contexts and various metric types (counters, sets, key-value pairs) - RuntimeMetricsContext: A specialized context for runtime metrics collection that doesn't require explicit context management The metrics system enables comprehensive monitoring and analysis of both compilation and execution performance. N)Iterator)AnyCallableOptional) TypeAliasc@s^eZdZdZddefddZdededd fd d Zdefd d Zde e eeffddZ d S)TopNz_ Helper to record a list of metrics, keeping only the top N "most expensive" elements. at_mostcCs||_g|_dSN)r heap)selfr r L/var/www/auris/lib/python3.10/site-packages/torch/_dynamo/metrics_context.py__init__s z TopN.__init__keyvalreturnNcCs0t|j|jkr tjntj}||j||fdSr )lenr r heapqheappush heappushpop)r rrfnr r radd szTopN.addcCs t|jSr )rr r r r r__len__%s z TopN.__len__cCsddt|jddDS)Ncss|] \}}||fVqdSr r ).0rrr r r )sz TopN.__iter__..T)reverse)sortedr rr r r__iter__(sz TopN.__iter__)r) __name__ __module__ __qualname____doc__intrrrrrtuplerr r r rrs r OnExitTypec @seZdZdefddZd$ddZdeeedeed e dd fd d Z de fd dZ de dedd fddZd%de de de dd fddZde de de dd fddZd%dee e fde dd fddZdee e fdd fddZde de dd fdd Zde de d!edd fd"d#Zd S)&MetricsContexton_exitcCs||_i|_d|_d|_dS)aQ Use this class as a contextmanager to create a context under which to accumulate a set of metrics, e.g., metrics gathered during a compilation. On exit of the contextmanager, call the provided 'on_exit' function and pass a dictionary of all metrics set during the lifetime of the contextmanager. rN)_on_exit_metrics_start_time_ns_levelr r(r r rr3s zMetricsContext.__init__rcCs,|jdkr i|_t|_|jd7_|S)z/ Initialize metrics recording. r)r,r*timetime_nsr+rr r r __enter__?s  zMetricsContext.__enter__exc_type exc_value _tracebackNcCsL|jd8_|jdksJ|jdkr$t}||j||j||dSdS)z> At exit, call the provided on_exit function. r.rN)r,r/r0r)r+r*)r r2r3r4 end_time_nsr r r__exit__Ks  zMetricsContext.__exit__cCs |jdkS)z4 True if we've entered the context. r)r,rr r r in_progress\s zMetricsContext.in_progressmetricvaluecCsD|jdkr td|d||jvrd|j|<|j||7<dS)7 Increment a metric by a given amount. rzCannot increment  outside of a MetricsContextNr, RuntimeErrorr*r r8r9r r r incrementbs   zMetricsContext.incrementF overwritecCsF|jdkr td|d||jvr|std|d||j|<dS)z Set a metric to a given value. Raises if the metric has been assigned previously in the current context. r Cannot set r;zMetric 'z-' has already been set in the current contextNr<)r r8r9r@r r rsetls  zMetricsContext.setrcCs@|jdkr td|d||jvri|j|<||j||<dS)a= Treats a give metric as a dictionary and set the k and value within it. Note that the metric must be a dictionary or not present. We allow this to be called multiple times (i.e. for features, it's not uncommon for them to be used multiple times within a single compilation). rrAr;Nr<)r r8rr9r r r set_key_valueys   zMetricsContext.set_key_valuevaluescCsL|jdkr td|j|@}|r|std|d|j|dS)z Set multiple metrics directly. This method does NOT increment. Raises if any metric has been assigned previously in the current context and overwrite is not set to True. r1Cannot update metrics outside of a MetricsContextz Metric(s) z- have already been set in the current contextN)r,r=r*keysupdate)r rDr@existingr r rrGs  zMetricsContext.updatecCs.|jdkr td|jdkr||dSdS)zA Update, but only when at the outermost context. rrEr.N)r,r=rG)r rDr r r update_outers  zMetricsContext.update_outercCsD|jdkr td|d||jvrt|j|<|j||dS)z8 Records a metric as a set() of values. rz Cannot add r;N)r,r=r*rBrr>r r r add_to_sets   zMetricsContext.add_to_setrcCs:|jdkrdS||jvrt|j|<|j|||dS)z; Records a metric as a TopN set of values. rN)r,r*rr)r r8rrr r r add_top_ns   zMetricsContext.add_top_n)rr')F)r r!r"r&rr1rtype BaseExceptionrr6boolr7strr$r?rBrCdictrGrIrJrKr r r rr'2s(       r'c @sJeZdZdefddZdededeeee fddfd d Z d d d Z dS)RuntimeMetricsContextr(cCs||_i|_d|_dS)z Similar to MetricsContext, but used to gather the runtime metrics that are decoupled from compilation, where there's not a natural place to insert a context manager. rN)r)r*r+r-r r rrs zRuntimeMetricsContext.__init__r8r9extrarNcCsp|jst|_||jvrd|j|<|j||7<|r4|D]\}}||jvr3|dur3||j|<q!dSdS)r:rN)r*r/r0r+items)r r8r9rRkvr r rr?s    zRuntimeMetricsContext.incrementcCs2|jrt}||j||jddi|_dSdS)zW Call the on_exit function with the metrics gathered so far and reset. N)r*r/r0r)r+)r r5r r rfinishs  zRuntimeMetricsContext.finish)rN) r r!r"r&rrOr$rrPrr?rVr r r rrQs  rQ)r#rr/collections.abcrtypingrrrZtyping_extensionsrrr$rPrOrLrMr&__annotations__r'rQr r r rs