a hZ@sUddlZddlZddlmZddlmZddlmZddlm Z m Z m Z m Z ddl Z ddl mZmZddlmZdd lmZmZdd lmZmZdd lmZd d lmZmZmZd dlmZd dl m!Z!m"Z"m#Z#gdZ$eGdddZ%Gddde%Z&Gddde%Z'Gdddej(Z)Gdddej(Z*Gdddej(Z+ee e&e'fe,e e-e ee.e e+dddZ/e0e e1ee e&e'fe e-fd d!d"Z2d#eiZ3e4e0e fe5d$<ie3d%d&d'Z6ie3d(d)d'Z7Gd*d+d+eZ8Gd,d-d-eZ9Gd.d/d/eZ:Gd0d1d1eZ;Gd2d3d3eZGd8d9d9eZ?Gd:d;d;eZ@Gdd?d?eZBee#d@e8jCfdAddBdCe e8e.e e+dDdEdFZDee#d@e9jCfdAddBdCe e9e.e e+dDdGdHZEee#d@e:jCfdAddBdCe e:e.e e+dDdIdJZFee#d@e;jCfdAddBdCe e;e.e e+dDdKdLZGee#d@ejCfdAddBdCe e>e.e e+dDdQdRZJee#d@e?jCfdAddBdCe e?e.e e+dDdSdTZKee#d@e@jCfdAddBdCe e@e.e e+dDdUdVZLee#d@eAjCfdAddBdCe eAe.e e+dDdWdXZMee#d@eBjCfdAddBdCe eBe.e e+dDdYdZZNdS)[N)Sequence) dataclass)partial)AnyCallableOptionalUnion)nnTensor)StochasticDepth)Conv2dNormActivationSqueezeExcitation)ImageClassificationInterpolationMode)_log_api_usage_once)register_modelWeights WeightsEnum)_IMAGENET_CATEGORIES)_make_divisible_ovewrite_named_paramhandle_legacy_interface) EfficientNetEfficientNet_B0_WeightsEfficientNet_B1_WeightsEfficientNet_B2_WeightsEfficientNet_B3_WeightsEfficientNet_B4_WeightsEfficientNet_B5_WeightsEfficientNet_B6_WeightsEfficientNet_B7_WeightsEfficientNet_V2_S_WeightsEfficientNet_V2_M_WeightsEfficientNet_V2_L_Weightsefficientnet_b0efficientnet_b1efficientnet_b2efficientnet_b3efficientnet_b4efficientnet_b5efficientnet_b6efficientnet_b7efficientnet_v2_sefficientnet_v2_mefficientnet_v2_lc@sneZdZUeed<eed<eed<eed<eed<eed<edejfed<e d eee eed d d Z d S) _MBConvConfig expand_ratiokernelstrideinput_channels out_channels num_layers.blockN)channels width_mult min_valuereturncCst||d|S)N)r)r9r:r;r>M/var/www/auris/lib/python3.9/site-packages/torchvision/models/efficientnet.pyadjust_channels9sz_MBConvConfig.adjust_channels)N) __name__ __module__ __qualname__float__annotations__intrr Module staticmethodrr@r>r>r>r?r1/s r1c sXeZdZd eeeeeeeeeedejfdd fdd Z e eeddd Z Z S) MBConvConfig?N.) r2r3r4r5r6r7r: depth_multr8r<c sL|||}|||}|||}| dur0t} t||||||| dSN)r@ adjust_depthMBConvsuper__init__) selfr2r3r4r5r6r7r:rKr8 __class__r>r?rP@s   zMBConvConfig.__init__r7rKcCstt||SrL)rFmathceilrTr>r>r?rMSszMBConvConfig.adjust_depth)rJrJN) rArBrCrDrFrrr rGrPrHrM __classcell__r>r>rRr?rI>s" rIc s@eZdZdeeeeeeeedejfddfdd Z Z S)FusedMBConvConfigN.)r2r3r4r5r6r7r8r<c s(|dur t}t|||||||dSrL) FusedMBConvrOrP)rQr2r3r4r5r6r7r8rRr>r?rPZs zFusedMBConvConfig.__init__)N) rArBrCrDrFrrr rGrPrWr>r>rRr?rXXs rXcsReZdZefeeedejfedejfddfdd Z e e dddZ Z S) rN.N)cnfstochastic_depth_prob norm_layerse_layerr<c s td|jkr dks*ntd|jdko>|j|jk|_g}tj}| |j|j }||jkr| t |j|d||d| t |||j |j|||dtd|jd}| |||ttjddd | t ||jd|ddtj||_t|d |_|j|_dS) Nrr illegal stride value kernel_sizer\activation_layer)r`r4groupsr\raT)inplace)Z activationrow)rOrPr4 ValueErrorr5r6use_res_connectr SiLUr@r2appendr r3maxr Sequentialr8r stochastic_depth) rQrZr[r\r]layersraexpanded_channelsZsqueeze_channelsrRr>r?rPjsL       zMBConv.__init__inputr<cCs&||}|jr"||}||7}|SrLr8rgrlrQrpresultr>r>r?forwards   zMBConv.forward) rArBrCrrIrDrr rGrPr rtrWr>r>rRr?rNis  :rNcsBeZdZeeedejfddfdd Ze e dddZ Z S) rY.N)rZr[r\r<c std|jkr dks*ntd|jdko>|j|jk|_g}tj}| |j|j }||jkr| t |j||j |j||d| t ||jd|ddn"| t |j|j|j |j||dtj||_t|d|_|j|_dS)Nrr r^r`r4r\rar_re)rOrPr4rfr5r6rgr rhr@r2rir r3rkr8r rl)rQrZr[r\rmrarnrRr>r?rPsH      zFusedMBConv.__init__rocCs&||}|jr"||}||7}|SrLrqrrr>r>r?rts   zFusedMBConv.forward) rArBrCrXrDrr rGrPr rtrWr>r>rRr?rYs  4rYc sneZdZd eeeefeeee e de j fe eddfdd Z eedd d Zeedd d ZZS)r皙?N.)inverted_residual_settingdropoutr[ num_classesr\ last_channelr<c s<tt||s tdn$t|tr) isinstancer1).0sr>r>r? z)EfficientNet.__init__..z:The inverted_residual_setting should be List[MBConvConfig]Nrr rucss|] }|jVqdSrL)r7)r}rZr>r>r? rz(EfficientNet.__init__..rrcr_T)prdZfan_out)moderJ)*rOrPrrfr|rall TypeErrorr BatchNorm2dr5rir rhsumranger7copyr6r4rDr8rkfeaturesZAdaptiveAvgPool2davgpoolZDropoutZLinear classifiermodulesZConv2dinitZkaiming_normal_ZweightZbiasZzeros_Z GroupNormZones_rUsqrtZ out_featuresZuniform_)rQrxryr[rzr\r{rmZfirstconv_output_channelsZtotal_stage_blocksZstage_block_idrZZstage_Z block_cnfZsd_probZlastconv_input_channelsZlastconv_output_channelsmZ init_rangerRr>r?rPsx            zEfficientNet.__init__)xr<cCs.||}||}t|d}||}|S)Nr)rrtorchflattenrrQrr>r>r? _forward_implMs     zEfficientNet._forward_implcCs ||SrL)rrr>r>r?rtWszEfficientNet.forward)rvrwNN)rArBrCrrrIrXrDrFrrr rGrPr rrtrWr>r>rRr?rsc r)rxryr{weightsprogresskwargsr<cKsT|durt|dt|jdt||fd|i|}|durP||j|dd|S)Nrz categoriesr{T)rZ check_hash)rlenmetarZload_state_dictZget_state_dict)rxryr{rrrmodelr>r>r? _efficientnet[s r)archrr<c Ks:|drtt|d|dd}|dddddd|d dd dd d |d d d d d d |d dd d dd|d d dddd|d d d ddd|d dddddg}d}n|drtdddd d d tddd d ddtddd dddtddd ddd td dddddtd dd dddg}d}n|drtdddd d dtddd d dd tddd ddd tddd dddtd dddddtd dd dd d!td ddd d"d g}d}n|d#r$tddddddtddd dddtddd dd$dtddd d$dd%td dddd&d'td dd d&d(d)td ddd(d*dg}d}ntd+|||fS),NZefficientnet_br:rKr:rKrr r (Pprc@r.0@ ir/i0ir0` izUnsupported model type ) startswithrrIpoprXrf)rrZ bneck_confrxr{r>r>r?_efficientnet_confnsT       rr _COMMON_META)rrzUhttps://github.com/pytorch/vision/tree/main/references/classification#efficientnet-v1)Zmin_sizerecipe)!rzUhttps://github.com/pytorch/vision/tree/main/references/classification#efficientnet-v2c @sJeZdZedeeddejdieddddd id d d d dZ e Z dS)rzJhttps://download.pytorch.org/models/efficientnet_b0_rwightman-7f5810bc.pthrr crop_size resize_size interpolationidP ImageNet-1Kg?5^IlS@g5^I bW@zacc@1zacc@5gNbX9?g~jts4@1These weights are ported from the original paper. num_params_metrics_ops _file_size_docsurlZ transformsrN rArBrCrrrrBICUBIC_COMMON_META_V1 IMAGENET1K_V1DEFAULTr>r>r>r?rs( rc @seZdZedeeddejdieddddd id d d d dZ edeeddej diedddddd id ddddZ e Z dS)rzJhttps://download.pytorch.org/models/efficientnet_b1_rwightman-bac287d4.pthrrivrg +S@gClW@rgCl?gM">@rrrz@https://download.pytorch.org/models/efficientnet_b1-c27df63c.pthzOhttps://github.com/pytorch/vision/issues/3995#new-recipe-with-lr-wd-crop-tuninggʡS@gƻW@gA`">@$ These weights improve upon the results of the original paper by using a modified version of TorchVision's `new training recipe `_. )rrrrrrN) rArBrCrrrrrrrBILINEARZ IMAGENET1K_V2rr>r>r>r?rsP  rc @sJeZdZedeeddejdiedddddid d d d d Z e Z dS)rzJhttps://download.pytorch.org/models/efficientnet_b2_rwightman-c35c1473.pthi rirgx&T@gp= W@rg rh?gʡEA@rrrNrr>r>r>r?rs( rc @sJeZdZedeeddejdieddddd id d d d dZ e Z dS)rzJhttps://download.pytorch.org/models/efficientnet_b3_rwightman-b3899882.pthi,rrirgnT@g~jtX@rgZd;?gd;OG@rrrNrr>r>r>r?rs( rc @sJeZdZedeeddejdieddddd id d d d dZ e Z dS)rzJhttps://download.pytorch.org/models/efficientnet_b4_rwightman-23ab8bcd.pthi|rri0!'rgjtT@gt&X@rg~jt@gKR@rrrNrr>r>r>r?r0s( rc @sJeZdZedeeddejdiedddddid d d d d Z e Z dS)r zJhttps://download.pytorch.org/models/efficientnet_b5_lukemelas-1a07897c.pthirirg#~jT@gx&1(X@rgx&1$@gK7]@rrrNrr>r>r>r?r Hs( r c @sJeZdZedeeddejdiedddddid d d d d Z e Z dS)r!zJhttps://download.pytorch.org/models/efficientnet_b6_lukemelas-24a108a5.pthirirgnU@gv:X@rg rh3@g$d@rrrNrr>r>r>r?r!`s( r!c @sJeZdZedeeddejdiedddddid d d d d Z e Z dS)r"zJhttps://download.pytorch.org/models/efficientnet_b7_lukemelas-c5b4e57e.pthiXricrg+U@g'1:X@rgsh|B@go@rrrNrr>r>r>r?r"xs( r"c @sJeZdZedeeddejdiedddddid d d d d Z e Z dS)r#zBhttps://download.pytorch.org/models/efficientnet_v2_s-dd5fe13b.pthrri8nGrg;OU@gx&18X@rgZd @gVT@rrrN rArBrCrrrrr_COMMON_META_V2rrr>r>r>r?r#s.r#c @sJeZdZedeeddejdiedddddid d d d d Z e Z dS)r$zBhttps://download.pytorch.org/models/efficientnet_v2_m-dc08266a.pthri:rgI +GU@gDlIX@rgE8@gQj@rrrNrr>r>r>r?r$s.r$c @sNeZdZedeeddejdddieddddd id d d d dZ e Z dS)r%zBhttps://download.pytorch.org/models/efficientnet_v2_l-59c71312.pthr)?rr)rrrmeanZstdiHfrgʡEsU@gOnrX@rg ףp= L@gI +i|@rrrN) rArBrCrrrrrrrrr>r>r>r?r%s2r%Z pretrained)rT)rr)rrrr<cKs<t|}tdddd\}}t||dd|||fi|S)aEfficientNet B0 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B0_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B0_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B0_Weights :members: r&rJrryrv)rverifyrrrrrrrxr{r>r>r?r&s r&cKs<t|}tdddd\}}t||dd|||fi|S)aEfficientNet B1 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B1_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B1_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B1_Weights :members: r'rJ皙?rryrv)rrrrrrr>r>r?r's r'cKs<t|}tdddd\}}t||dd|||fi|S)aEfficientNet B2 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B2_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B2_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B2_Weights :members: r(r333333?rry333333?)rrrrrrr>r>r?r('s r(cKs<t|}tdddd\}}t||dd|||fi|S)aEfficientNet B3 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B3_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B3_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B3_Weights :members: r)rffffff?rryr)rrrrrrr>r>r?r)Fs  r)cKs<t|}tdddd\}}t||dd|||fi|S)aEfficientNet B4 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B4_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B4_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B4_Weights :members: r*r?rry皙?)rrrrrrr>r>r?r*js  r*cKsLt|}tdddd\}}t||dd|||fdttjdd d i|S) aEfficientNet B5 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B5_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B5_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B5_Weights :members: r+g?g@rryrr\MbP?{Gz?epsZmomentum)r rrrrrr rrr>r>r?r+s  r+cKsLt|}tdddd\}}t||dd|||fdttjdd d i|S) aEfficientNet B6 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B6_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B6_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B6_Weights :members: r,rg@rryrr\rrr)r!rrrrrr rrr>r>r?r,s  r,cKsLt|}tdddd\}}t||dd|||fdttjdd d i|S) aEfficientNet B7 model architecture from the `EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks `_ paper. Args: weights (:class:`~torchvision.models.EfficientNet_B7_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_B7_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_B7_Weights :members: r-g@g@rryrr\rrr)r"rrrrrr rrr>r>r?r-s  r-cKsDt|}td\}}t||dd|||fdttjddi|S)a Constructs an EfficientNetV2-S architecture from `EfficientNetV2: Smaller Models and Faster Training `_. Args: weights (:class:`~torchvision.models.EfficientNet_V2_S_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_V2_S_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_V2_S_Weights :members: r.ryrvr\rr)r#rrrrrr rrr>r>r?r.s    r.cKsDt|}td\}}t||dd|||fdttjddi|S)a Constructs an EfficientNetV2-M architecture from `EfficientNetV2: Smaller Models and Faster Training `_. Args: weights (:class:`~torchvision.models.EfficientNet_V2_M_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_V2_M_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_V2_M_Weights :members: r/ryrr\rr)r$rrrrrr rrr>r>r?r/#s    r/cKsDt|}td\}}t||dd|||fdttjddi|S)a Constructs an EfficientNetV2-L architecture from `EfficientNetV2: Smaller Models and Faster Training `_. Args: weights (:class:`~torchvision.models.EfficientNet_V2_L_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.EfficientNet_V2_L_Weights` below for more details, and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.efficientnet.EfficientNet`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.EfficientNet_V2_L_Weights :members: r0ryrr\rr)r%rrrrrr rrr>r>r?r0Is    r0)OrrUcollections.abcrZ dataclassesr functoolsrtypingrrrrrr r Ztorchvision.opsr Zops.miscr rZtransforms._presetsrrutilsrZ_apirrrZ_metar_utilsrrr__all__r1rIrXrGrNrYrrDrFboolrstrtuplerrdictrErrrrrrrr r!r"r#r$r%rr&r'r(r)r*r+r,r-r.r/r0r>r>r>r?s       C=s  80    " " # # # $ $