a hT@sUdZddlZddlZddlZddlmZddlmZmZm Z ddl m Z e e ZGdddZeeeeeefe eee egdfZe ed<Gd d d ZGd d d ZdS) a[Metrics collection and management system for Dynamo. This module provides context managers for gathering and reporting metrics during compilation and runtime. It includes two main components: - MetricsContext: A context manager for collecting metrics during compilation, supporting nested contexts and various metric types (counters, sets, key-value pairs) - RuntimeMetricsContext: A specialized context for runtime metrics collection that doesn't require explicit context management The metrics system enables comprehensive monitoring and analysis of both compilation and execution performance. N)Iterator)AnyCallableOptional) TypeAliasc@sZeZdZdZdedddZeedddd Zed d d Ze e eefd d dZ dS)TopNz_ Helper to record a list of metrics, keeping only the top N "most expensive" elements. )at_mostcCs||_g|_dSN)r heap)selfr r K/var/www/auris/lib/python3.9/site-packages/torch/_dynamo/metrics_context.py__init__ sz TopN.__init__N)keyvalreturncCs0t|j|jkrtjntj}||j||fdSr )lenr r heapqheappush heappushpop)r rrfnr r radd$szTopN.addrcCs t|jSr )rr r r r r__len__)sz TopN.__len__cCsddt|jddDS)Ncss|]\}}||fVqdSr r ).0rrr r r -z TopN.__iter__..T)reverse)sortedr rr r r__iter__,sz TopN.__iter__)r) __name__ __module__ __qualname____doc__intrrrrrtupler!r r r rrs r OnExitTypec@seZdZedddZddddZeeeeee ddd d Z e dd d Z e edd ddZd"e e e ddddZe e e ddddZd#ee e fe ddddZee e fddddZe e dd ddZe e eddd d!ZdS)$MetricsContexton_exitcCs||_i|_d|_d|_dS)aQ Use this class as a contextmanager to create a context under which to accumulate a set of metrics, e.g., metrics gathered during a compilation. On exit of the contextmanager, call the provided 'on_exit' function and pass a dictionary of all metrics set during the lifetime of the contextmanager. rN)_on_exit_metrics_start_time_ns_levelr r+r r rr7szMetricsContext.__init__rcCs,|jdkri|_t|_|jd7_|S)z/ Initialize metrics recording. r)r/r-timetime_nsr.rr r r __enter__Cs   zMetricsContext.__enter__N)exc_type exc_value _tracebackrcCsj|jd8_|jdksJ|jdkrfz"t}||j||j||WntydtdYn0dS)z> At exit, call the provided on_exit function. r1rz0Unexpected exception logging compilation metricsN) r/r2r3r,r.r- Exceptionlog exception)r r5r6r7 end_time_nsr r r__exit__Os   zMetricsContext.__exit__cCs |jdkS)z4 True if we've entered the context. r)r/rr r r in_progresscszMetricsContext.in_progress)metricvaluercCsD|jdkrtd|d||jvr.d|j|<|j||7<dS)7 Increment a metric by a given amount. rzCannot increment  outside of a MetricsContextNr/ RuntimeErrorr-r r>r?r r r incrementis    zMetricsContext.incrementF)r>r? overwritercCsF|jdkrtd|d||jvr8|s8td|d||j|<dS)z Set a metric to a given value. Raises if the metric has been assigned previously in the current context. r Cannot set rAzMetric 'z-' has already been set in the current contextNrB)r r>r?rFr r rsetss  zMetricsContext.set)r>rr?rcCs@|jdkrtd|d||jvr.i|j|<||j||<dS)a= Treats a give metric as a dictionary and set the k and value within it. Note that the metric must be a dictionary or not present. We allow this to be called multiple times (i.e. for features, it's not uncommon for them to be used multiple times within a single compilation). rrGrANrB)r r>rr?r r r set_key_values    zMetricsContext.set_key_value)valuesrFrcCsL|jdkrtd|j|@}|r<|srrrcCs:|jdkrdS||jvr$t|j|<|j|||dS)z; Records a metric as a TopN set of values. rN)r/r-rr)r r>rrr r r add_top_ns    zMetricsContext.add_top_n)F)F)r"r#r$r(rr4rtype BaseExceptionrr<boolr=strr&rErHrIdictrMrOrPrQr r r rr)6s       r)c@sJeZdZedddZd eeeeee fddddZ ddd d Z dS) RuntimeMetricsContextr*cCs||_i|_d|_dS)z Similar to MetricsContext, but used to gather the runtime metrics that are decoupled from compilation, where there's not a natural place to insert a context manager. rN)r,r-r.r0r r rrszRuntimeMetricsContext.__init__N)r>r?extrarcCsl|jst|_||jvr$d|j|<|j||7<|rh|D]$\}}||jvrB|durB||j|<qBdS)r@rN)r-r2r3r.items)r r>r?rXkvr r rrEs   zRuntimeMetricsContext.incrementrcCs^|jrZzJz"t}||j||jddWntyFtdYn0Wi|_ni|_0dS)zW Call the on_exit function with the metrics gathered so far and reset. Nz,Unexpected exception logging runtime metrics)r-r2r3r,r.r8r9r:)r r;r r rfinishs zRuntimeMetricsContext.finish)N) r"r#r$r(rrUr&rrVrrEr\r r r rrWs  rW)r%rloggingr2collections.abcrtypingrrrZtyping_extensionsr getLoggerr"r9rr&rVrUrRrSr(__annotations__r)rWr r r rs