o Zhr@sBddlmZddlmZddlmZerddlmZd d d Zd S)) annotations) TYPE_CHECKING)is_torch_available)nnmodule nn.ModulereturnboolcCsDtsdSddl}|jsdSddl}t||jjjp!t|ddS)NFrZ_is_fsdp_managed_module) rtorch distributedZ is_availableZtorch.distributed.fsdp isinstanceZfsdpZFullyShardedDataParallelgetattr)rr rM/var/www/auris/lib/python3.10/site-packages/transformers/integrations/fsdp.pyis_fsdp_managed_modules rN)rrr r ) __future__rtypingrutilsrr rrrrrrs