o ‡ZŽhã@s dZddlZddlmZddlmZddlmZmZ dej de fdd„Z dej de e ee ej ffd d „Zdej de efd d „Zdej de fd d„ZdS)zú NOTE: This file must be imported like ``import torch.distributed.fsdp._traversal_utils`` and not like ``from torch.distirbuted.fsdp._traversal_utils import ...`` to avoid circular imports. For brevity, we may import the file as ``traversal_utils``. éN©Ú _get_registry)Ú _FSDPStateÚ_get_module_fsdp_stateÚmoduleÚreturncCst|ƒ}|dur dSd|vS)zA Returns if ``module`` can compose with ``fully_shard``. NTZ replicater)rÚregistry©r úV/var/www/auris/lib/python3.10/site-packages/torch/distributed/fsdp/_traversal_utils.pyÚ _composable"sr c Csªg}g}tƒ}tƒ}t |g¡}|rQ| ¡}| |¡t|ƒs qtt| ¡ƒƒD] }||vr3|  |¡q(t |ƒ}|durO||vrO| |¡|  |¡|  |¡|s||fS)a÷ Returns a tuple containing: 1. A list of the ``_FSDPState`` instances in the module tree rooted at ``module`` without any duplicates and following the ``module.modules()`` traversal order (which is assumed to be depth-first). 2. A corresponding list of the modules owning the states in the first list. For the wrapper code path, both returned lists are the same, each containing all ``FullyShardedDataParallel`` instances. For the composable code path, this returns a list of all composable state instances and a list of the corresponding fully sharded modules. See [Note: Fully Sharded Module]. NOTE: The traversal does not proceed into any module annotated by an incompatible API (e.g. ``replicate``). N) ÚsetÚ collectionsÚdequeÚpopleftÚaddr ÚreversedÚlistÚchildrenÚ appendleftrÚappend) rÚ fsdp_statesZ fsdp_modulesZvisited_fsdp_statesZvisited_modulesrÚ submoduleZ child_moduleZoptional_stater r r Ú_get_fsdp_states_with_modules0s*   €   ô rcCst|ƒ\}}|S)z*See :func:`_get_fsdp_states_with_modules`.)r)rrÚ_r r r Ú_get_fsdp_states`s rcCsdd„t|ƒDƒ}|S)z‡ Returns all ``FlatParamHandle`` s in the module tree rooted at ``module`` following the rules in :func:`_get_fsdp_state`. cSsg|] }|jdur|j‘qS)N)Z_handle)Ú.0Z fsdp_stater r r Ú ks  þz%_get_fsdp_handles..)r)rZhandlesr r r Ú_get_fsdp_handlesfsþr)Ú__doc__r Ztorch.nnÚnnZ&torch.distributed._composable.contractrZ$torch.distributed.fsdp._common_utilsrrÚModuleÚboolr Útuplerrrrr r r r Ús  ÿ þ0