o Zh~@s@ddlZddlZddlmZddlmZdgZGdddZdS)N)wraps)BaseSparsifier BaseSchedulerc@sZeZdZdddZddZddZd d Zd d ZdddZddZ dddZ ddZ d S)rFcCszt|tstt|jd||_dd|jD|_||_dd}||jj |j_ d|j_ d|_ ||_ d|_ | dS)Nz6 is not an instance of torch.ao.pruning.BaseSparsifiercSg|]}|dqSsparsity_level.0groupr r X/var/www/auris/lib/python3.10/site-packages/torch/ao/pruning/scheduler/base_scheduler.py z*BaseScheduler.__init__..csNt|ddr|St|j|jj~tfdd}d|_|S)N _with_counterFcs.}|jd7_|}||i|S)N) _step_count__get__)argskwargsinstancewrappedclsfuncZ instance_refr r wrapper+s z=BaseScheduler.__init__..with_counter..wrapperT)getattrweakrefref__self____func__ __class__rr)methodrr rr with_counters  z,BaseScheduler.__init__..with_counterrF) isinstancer TypeErrortype__name__ sparsifiergroupsbase_sl last_epochsteprverbose_get_sl_called_within_step)selfr(r+r-r#r r r __init__s  zBaseScheduler.__init__cCsdd|jDS)zReturns the state of the scheduler as a :class:`dict`. It contains an entry for every variable in self.__dict__ which is not the sparsifier. cSsi|] \}}|dkr||qS)r(r )r keyvaluer r r Gsz,BaseScheduler.state_dict..)__dict__itemsr/r r r state_dictAszBaseScheduler.state_dictcCs|j|dS)zLoads the schedulers state. Args: state_dict (dict): scheduler state. Should be an object returned from a call to :meth:`state_dict`. N)r4update)r/r7r r r load_state_dictKszBaseScheduler.load_state_dictcCs|jS)z9Return last computed sparsity level by current scheduler.)_last_slr6r r r get_last_slTszBaseScheduler.get_last_slcCs|jstdt)NzUTo get the last sparsity level computed by the scheduler, please use `get_last_sl()`.)r.warningswarnNotImplementedErrorr6r r r get_slXs zBaseScheduler.get_slNcCsP|r&|durtd|d|dddStd|dd|d|dddSdS) z#Display the current sparsity level.Nz"Adjusting sparsity level of group z to z.4e.zEpoch Z5dz$: adjusting sparsity level of group )print)r/Z is_verboser slepochr r r print_slcszBaseScheduler.print_slcCsD|jjd}|d7}|d|jd7}|d|jd7}|d7}|S)Nz ( z Sparsifier z base_sl: ))r!r'r(r*)r/ format_stringr r r __repr__ms zBaseScheduler.__repr__cCs|jdkrt|jjdstdtn |jjdkrtdt|jd7_Gddd}|||jd7_|}Wdn1sGwYt t |jj |D]\}}|\}}||d<| |j |||qUdd |jj D|_d |j_dS) NrrzSeems like `sparsifier.step()` has been overridden after sparsity scheduler initialization. Please, make sure to call `sparsifier.step()` before `scheduler.step()`.zDetected call of `scheduler.step()` before `sparsifier.step()`. You have to make sure you run the sparsifier.step() BEFORE any calls to the scheduler.step().c@s$eZdZddZddZddZdS)z/BaseScheduler.step.._enable_get_sl_callcSs ||_dSN)o)r/rJr r r r0s z8BaseScheduler.step.._enable_get_sl_call.__init__cSs d|j_|S)NTrJr.r6r r r __enter__sz9BaseScheduler.step.._enable_get_sl_call.__enter__cSs d|j_dS)NFrK)r/r&r2 tracebackr r r __exit__s z8BaseScheduler.step.._enable_get_sl_call.__exit__N)r' __module__ __qualname__r0rLrNr r r r _enable_get_sl_calls rQrcSrrr r r r r rrz&BaseScheduler.step..T)rhasattrr(r,r<r= UserWarningr+r? enumeratezipr)rDr-r:Zenable_mask_update)r/rCrQvaluesidataZ param_grouprBr r r r,us.     zBaseScheduler.stepcCsPt|jj}t|ttfs|g|St||kr$td|dt|t|S)zPUtility that extends it to the same length as the .groups, ensuring it is a listzExpected variable of length z , but got )lenr(r)r$listtuple ValueError)r/varnr r r _make_sure_a_lists   zBaseScheduler._make_sure_a_list)rFrI) r'rOrPr0r7r9r;r?rDrHr,r_r r r r r s 3     -)r<r functoolsrZ+torch.ao.pruning.sparsifier.base_sparsifierr__all__rr r r r s