a h;@sJddlmZddlmZddlmZmZmZddlZddlm Z m Z ddl m Z ddlmZmZdd lmZdd lmZdd lmZd d lmZmZmZd dlmZd dlmZmZgdZ Gddde j!Z"Gddde j#Z$GdddZ%Gddde j#Z&e'e%e(eee)ee&dddZ*dedddZ+Gd d!d!eZ,Gd"d#d#eZ-Gd$d%d%eZ.Gd&d'd'eZ/eed(e,j0fd)dd*d+ee,e)ee&d,d-d.Z1eed(e-j0fd)dd*d+ee-e)ee&d,d/d0Z2eed(e.j0fd)dd*d+ee.e)ee&d,d1d2Z3eed(e/j0fd)dd*d+ee/e)ee&d,d3d4Z4dS)5)Sequence)partial)AnyCallableOptionalN)nnTensor) functional)Conv2dNormActivationPermute)StochasticDepth)ImageClassification)_log_api_usage_once)register_modelWeights WeightsEnum)_IMAGENET_CATEGORIES)_ovewrite_named_paramhandle_legacy_interface) ConvNeXtConvNeXt_Tiny_WeightsConvNeXt_Small_WeightsConvNeXt_Base_WeightsConvNeXt_Large_Weights convnext_tinyconvnext_small convnext_baseconvnext_largec@seZdZeedddZdS) LayerNorm2dxreturncCs>|dddd}t||j|j|j|j}|dddd}|S)Nrr r)ZpermuteFZ layer_normZnormalized_shapeweightbiasepsselfr"r+I/var/www/auris/lib/python3.9/site-packages/torchvision/models/convnext.pyforward szLayerNorm2d.forwardN)__name__ __module__ __qualname__rr-r+r+r+r,r sr csHeZdZd eeeedejfddfdd Ze e dddZ Z S) CNBlockN.) layer_scalestochastic_depth_prob norm_layerr#c st|dur ttjdd}ttj||dd|ddtgd||tj|d|dd t tjd||dd tgd |_ t t |d d ||_t|d |_dS) Nư>r(r$T) kernel_sizepaddinggroupsr')rr r$r)Z in_featuresZ out_featuresr')rr$rr rrow)super__init__rr LayerNorm SequentialConv2dr LinearZGELUblock ParametertorchZonesr2r stochastic_depth)r*Zdimr2r3r4 __class__r+r,r>(s    zCNBlock.__init__)inputr#cCs&|j||}||}||7}|SN)r2rCrF)r*rIresultr+r+r,r-?s zCNBlock.forward)N) r.r/r0floatrrrModuler>rr- __classcell__r+r+rGr,r1'sr1c@s2eZdZeeeeddddZedddZdS) CNBlockConfigN)input_channels out_channels num_layersr#cCs||_||_||_dSrJ)rPrQrR)r*rPrQrRr+r+r,r>HszCNBlockConfig.__init__)r#cCs>|jjd}|d7}|d7}|d7}|d7}|jfi|jS)N(zinput_channels={input_channels}z, out_channels={out_channels}z, num_layers={num_layers}))rHr.format__dict__)r*sr+r+r,__repr__Rs  zCNBlockConfig.__repr__)r.r/r0intrr>strrXr+r+r+r,rOFs  rOc sreZdZdeeeeeeede j feede j fe ddfdd Z e e d d d Ze e d d d ZZS)rr5N.) block_settingr3r2 num_classesrCr4kwargsr#c stt||s tdn$t|trkz%ConvNeXt.__init__..z/The block_setting should be List[CNBlockConfig]r5r6rr$r;T)r8strider9r4Zactivation_layerr'css|] }|jVqdSrJ)rR)racnfr+r+r, rcz$ConvNeXt.__init__..g?rr )r8rdg{Gz?)Zstd)!r=r>r ValueErrorr`rall TypeErrorr1rr rPappendr sumrangerRrr@rQrAfeaturesZAdaptiveAvgPool2davgpoolZFlattenrB classifiermodulesinitZ trunc_normal_r&r'Zzeros_)r*r]r3r2r^rCr4r_ZlayersZfirstconv_output_channelsZtotal_stage_blocksZstage_block_idreZstage_Zsd_probZ lastblockZlastconv_output_channelsmrGr+r,r>\sj           zConvNeXt.__init__r!cCs"||}||}||}|SrJ)rnrorpr)r+r+r, _forward_impls   zConvNeXt._forward_implcCs ||SrJ)rur)r+r+r,r-szConvNeXt.forward)r[r5r\NN)r.r/r0listrOrLrYrrrrMrr>rrur-rNr+r+rGr,r[s"Nr)r]r3weightsprogressr_r#cKsR|durt|dt|jdt|fd|i|}|durN||j|dd|S)Nr^ categoriesr3T)rxZ check_hash)rlenmetarZload_state_dictZget_state_dict)r]r3rwrxr_modelr+r+r, _convnexts r}) r~zNhttps://github.com/pytorch/vision/tree/main/references/classification#convnexta These weights improve upon the results of the original paper by using a modified version of TorchVision's `new training recipe `_. )Zmin_sizeryZrecipeZ_docsc @sDeZdZedeedddieddddd id d d d ZeZdS)rz>https://download.pytorch.org/models/convnext_tiny-983f1562.pthZ crop_sizeZ resize_sizeiH< ImageNet-1KgzGT@gMbX X@zacc@1zacc@5gm@gV-G[@Z num_paramsZ_metricsZ_ops _file_sizeurlZ transformsr{N r.r/r0rrr _COMMON_META IMAGENET1K_V1DEFAULTr+r+r+r,rs" rc @sDeZdZedeedddieddddd id d d d ZeZdS)rz?https://download.pytorch.org/models/convnext_small-0c510722.pthrriHZrgClT@g)X@rg|?5^!@g"~g@rrNrr+r+r+r,rs" rc @sDeZdZedeedddieddddd id d d d ZeZdS)rz>https://download.pytorch.org/models/convnext_base-6075fbad.pthrrihGrgU@gHz7X@rg(\µ.@g/$!u@rrNrr+r+r+r,rs" rc @sDeZdZedeedddieddddd id d d d ZeZdS)rz?https://download.pytorch.org/models/convnext_large-ea097f82.pthrrri rg"~U@gX9v>X@rg|?5.A@gK@rrNrr+r+r+r,rs" rZ pretrained)rwT)rwrx)rwrxr_r#cKsXt|}tdddtdddtdddtdddg}|dd }t||||fi|S) aConvNeXt Tiny model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Tiny_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Tiny_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Tiny_Weights :members: `r$ Nr3g?)rverifyrOpopr}rwrxr_r]r3r+r+r,r"s      rcKsXt|}tdddtdddtdddtdddg}|dd }t||||fi|S) aConvNeXt Small model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Small_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Small_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Small_Weights :members: rrr$rrNr3g?)rrrOrr}rr+r+r,rAs      rcKsXt|}tdddtdddtdddtdddg}|dd }t||||fi|S) aConvNeXt Base model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Base_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Base_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Base_Weights :members: r$iirNr3?)rrrOrr}rr+r+r,rbs      rcKsXt|}tdddtdddtdddtdddg}|dd }t||||fi|S) aConvNeXt Large model architecture from the `A ConvNet for the 2020s `_ paper. Args: weights (:class:`~torchvision.models.convnext.ConvNeXt_Large_Weights`, optional): The pretrained weights to use. See :class:`~torchvision.models.convnext.ConvNeXt_Large_Weights` below for more details and possible values. By default, no pre-trained weights are used. progress (bool, optional): If True, displays a progress bar of the download to stderr. Default is True. **kwargs: parameters passed to the ``torchvision.models.convnext.ConvNext`` base class. Please refer to the `source code `_ for more details about this class. .. autoclass:: torchvision.models.ConvNeXt_Large_Weights :members: rrr$rirNr3r)rrrOrr}rr+r+r,rs      r)5collections.abcr functoolsrtypingrrrrErrZtorch.nnr r%Zops.miscr r Zops.stochastic_depthr Ztransforms._presetsrutilsrZ_apirrrZ_metar_utilsrr__all__r?r rMr1rOrrvrLboolr}rrrrrrrrrrr+r+r+r,sj        Z  $ $