o Zhi(@s"ddlZddlZddlmZddlmZddlmZddlm Z ddl m Z ddl m Z ddlmZeeZeejgdZe d d d ed efd dZdeeegefdeed dfddZdeedeed eefddZe d d deded efddZe d d GdddZdS)N)wraps)QueueCallable) compatibility) GraphModule) PassResult)pass_result_wrapper this_before_that_pass_constraint PassManagerF)Zis_backward_compatiblefnreturncs:durdStfdd}tstj|_|S)a+ Wrapper for passes which currently do not return a PassResult. This wrapper makes them return a PassResult containing the modified object and True for the "modified" flag. Args: fn (Callable[Module, Any]) Returns: wrapped_fn (Callable[Module, PassResult]) NcsB|}|dur t|dSt|tr|St|tjrt|dSdS)NT)r isinstancennModule)Zgmresr Q/var/www/auris/lib/python3.10/site-packages/torch/fx/passes/infra/pass_manager.py wrapped_fn$s    z'pass_result_wrapper..wrapped_fn)rinspect isfunctiontype__name__)r rrrrr s  r constraintpassescCslt|D]/\}}t||ddD] \}}|||rqtd|d|d|d|d|d|d qdS) Nz,pass schedule constraint violated. Expected z before z but found z at index z and z at indexz in pass list.) enumerate RuntimeError)rriajbrrr"_validate_pass_schedule_constraint4s" r# constraintsc sHt|dkr|Sdd|D}t|dt}|D]0}|D] }||kr%q|D]}|||s=||||d7<q'q|dkrJ||qt|d}g}|s|} || d|| <|| D]} || s| d8<| dkr|| qh|rWtt fdd } t| dkrd | } t | |S) z Args passes: Passes that we are ordering constraints: Constraints applied on these passes Returns A sorted list of callables and a boolean of if a circular dependency existed rcSsi|]}|gqSrr.0prrr Rsz,_topological_sort_passes..rFTcs |dkS)Nrr)r'Z indegree_maprrqs z*_topological_sort_passes..z:Circular dependency detected within the following passes: ) lendictfromkeysrappendputemptygetlistfilterkeysr) rr$graph candidatesr r"rvisitedZ sorted_passesr'nZ cycle_passeserrorrr)r_topological_sort_passesBsJ           r:thisthatcsdtdtffdd }|S)a Defines a partial order ('depends on' function) where `this` must occur before `that`. For example, the following pass list and constraint list would be invalid. ``` passes = [pass_b, pass_a] constraints = [this_before_that_pass_constraint(pass_a, pass_b)] ``` Args: this (Callable): pass which should occur first that (Callable): pass which should occur later Returns: depends_on (Callable[[Object, Object], bool] r r"cs|kp|kSNr)r r"r<r;rr depends_onsz4this_before_that_pass_constraint..depends_onr)r;r<r?rr>rr {sr c@seZdZUdZeeejgefe d<eeeege fe d<dZ e e d<dZ e e d<     d d e d e fd d Zd efddZdefddZddZddZdeddfddZdejddfddZdejdefddZdS)!r ad Construct a PassManager. Collects passes and constraints. This defines the pass schedule, manages pass constraints and pass execution. Args: passes (Optional[List[Callable]]): List of passes. A pass is a callable which modifies an object and returns a PassResult constraint (Optional[List[Callable]]): List of constraints. A constraint is a callable which takes two passes (A, B) and returns True if A depends on B and False otherwise. See implementation of `this_before_that_pass_constraint` for example. steps (int): Max number of times we run the passes (default = 1). run_checks_after_each_pass (bool): Whether to run checks and linting after each pass suppress_check_failures (bool): Whether to raise errors when running checks rr$F _validatedrstepsNrun_checks_after_each_passsuppress_check_failurescCs.|pg|_|pg|_|r||_||_||_dSr=)rr$rArBrC)selfrr$rArBrCrrr__init__s   zPassManager.__init___passcC|j|d|_dS)z> Adds a pass into the current list of passes. FN)rr.r@)rDrFrrradd_pass  zPassManager.add_passrcCrG)zI Adds a constraint into the current list of constraints. FN)r$r.r@rDrrrradd_constraintrIzPassManager.add_constraintcCs,|jrdS|jD]}t||jqd|_dS)z Validates that current pass schedule defined by `self.passes` is valid according to all constraints in `self.constraints` NT)r@r$r#rrJrrrvalidate_constraintss   z PassManager.validate_constraintscCst|j|j|_d|_dS)ab Finds a valid traversal order based on the given constraints and orders the passes based on this order. If a circular dependency exists between the constraints and steps = 1, then we will raise an error because if steps != 1 this means that we will re-run the passes, allowing for circular dependencies. TN)r:rr$r@)rDrrrsolve_constraintss zPassManager.solve_constraintscheckr cCs8t|}tt|jdkrtdt|d|dS)z Adds a function which takes runs various checks on a given graph module. This function is run before and after each pass if the `run_checks_after_each_pass` flag is enabled. rzEPassManager check function should only take in one variable, a modulerNN)r signaturer+r2 parametersvalues TypeErrorsetattr)rDrNsigrrr add_checkss zPassManager.add_checksmodulecCsdSr=r)rDrVrrrrNszPassManager.checkc CsD|js|||d}t|jD]}d}t|jD]w\}}t|r(|j nt |j }t d|z;||}t |tsLt|dsLtd|dd|j}|pS|j}t |tret d||j||jrm||Wqty} zdd |jd |D} d |d | } t| | d } ~ ww|p|}|snqt||S) a} Runs a list of passes in the order based on `self.passes` on the given graph module. Each time a pass is run, checks and linting will be run on the graph module if `run_checks_after_each_pass` is set. If the module is a graph module, we will run the list of passes until the graph stops changing, or until `steps` number of times. FzRunning pass '%s' graph_modulezThe result of the pass z should be type PassResult.z)Please wrap it with pass_result_wrapper()zGraph after pass '%s': %scSs&g|]}t|r |jnt|jqSr)rrrrr%rrr )sz(PassManager.__call__..Nz$An error occurred when running the 'z#' pass after the following passes: )r@rMrNrangerArrrrrrloggerdebugrrhasattrrRrWmodifiedrr5Z recompilerB Exception) rDrVZoverall_modified_r]rr fn_namereZprev_pass_namesmsgrrr__call__sP            zPassManager.__call__)NNNFF)r __module__ __qualname____doc__r2rrrr__annotations__boolr@rAintrErHrKrLrMrUrNrcrrrrr s.      r )rlogging functoolsrqueuertypingrZtorch.nnrZtorch.fx._compatibilityrZtorch.fx.graph_modulerZtorch.fx.passes.infra.pass_baser getLoggerrrZsetLevelWARNING__all__r rhr2r#r:r r rrrrs@           9