fTh <SrSSKrSSKrSSKJrJrJrJrJ r SSK r SSK r SSK J r SSK Jr SSKJrJr SSKJr SS KJrJr SS KJr S S KJr \R6"\5r"S S\ R<5r\ R@RBS5r"Sr#"SS\ R<5r$S1S\ RJS\&S\'S\ RJ4Sjjr("SS\ R<5r)"SS\ R<5r*"SS\ R<5r+"SS\ R<5r,S r-S!r."S"S#\ R<5r/"S$S%\ R<5r0S&\ R<SS4S'jr1\"S(S)\55r2\"S*S+\255r3\"S,S-9"S.S/\2\55r4/S0Qr5g)2zPyTorch ViTDet backbone.N)DictListOptionalTupleUnion)nn)ACT2FN)BackboneOutputBaseModelOutput)PreTrainedModel)auto_docstringlogging) BackboneMixin) VitDetConfigcl^\rSrSrSrU4SjrSrS\RS\R4Sjr Sr U=r $) VitDetEmbeddings$z This class turns `pixel_values` of shape `(batch_size, num_channels, height, width)` into the initial `hidden_states` (patch embeddings) to be consumed by a Transformer. cx>[TU]5 URURp2URUR pT[ U[RR5(aUOX"4n[ U[RR5(aUOX34nUSUS-USUS--nX l X0lX@lX`l UR(a@US-n[R"[R "SXqR 55UlOSUl[R$"XEX3S9Ulg)Nrr) kernel_sizestride)super__init__pretrain_image_size patch_size num_channels hidden_size isinstance collectionsabcIterable image_size num_patches use_absolute_position_embeddingsr Parametertorchzerosposition_embeddingsConv2d projection) selfconfigr#rrrr$ num_positions __class__s b/var/www/auris/envauris/lib/python3.13/site-packages/transformers/models/vitdet/modeling_vitdet.pyrVitDetEmbeddings.__init__*s !'!;!;V=N=NJ$*$7$79K9Kk#-j+//:R:R#S#SZZdYq #-j+//:R:R#S#SZZdYq !!} 1 5*Q-:VW=:XY $$(&  2 2'!OM')||EKK=RdRd4e'fD $'+D $))L:icU(a USS2SS24nURSn[[R"U55nXf-U:wa [ S5e[ R R5(d Xc:wdXd:waX[RRURSXfS5RSSSS5X44SS S 9nURSSSS5$URSX4S5$) a? Calculate absolute positional embeddings. If needed, resize embeddings and remove cls_token dimension for the original embeddings. Args: abs_pos_embeddings (`torch.Tensor`): Absolute positional embeddings with (1, num_position, num_channels). has_cls_token (`bool`): If true, has 1 embedding in abs_pos_embeddings for cls token. height (`int`): Height of input image tokens. width (`int`): Width of input image tokens. Returns: Absolute positional embeddings after processing with shape (1, height, width, num_channels) Nrz5Absolute position embeddings must be a square number.rr bicubicF)sizemode align_corners) shapeintmathsqrt ValueErrorr'jit is_tracingr functional interpolatereshapepermute)r,abs_pos_embeddings has_cls_tokenheightwidth num_positionr7new_abs_pos_embeddingss r0get_absolute_positions'VitDetEmbeddings.get_absolute_positions@s$ !3AqrE!: )//2 499\*+ ;, &TU U 99   ! !dn %']]%>%>"**1d"=EEaAqQ_# &?& "*11!Q1= =%--aC Cr2 pixel_valuesreturnczURSnX R:wa[SURSUS35eURU5nURbbUR SSSS5nX0R URSURSURS5-nUR SSSS5nU$) NrzoMake sure that the channel dimension of the pixel values match with the one set in the configuration. Expected z but got .rr5r T)r:rr>r+r)rDrK)r,rMr embeddingss r0forwardVitDetEmbeddings.forwardfs#))!, ,, ,!../yaI __\2  # # /#++Aq!Q7J#&A&A(($ 0@0@0CZEUEUVWEX'J$++Aq!Q7Jr2)r#rr$rr)r+) __name__ __module__ __qualname____firstlineno____doc__rrKr'TensorrR__static_attributes__ __classcell__r/s@r0rr$s5 j,$DLELLU\\r2rcH[S[X5-S- 5nURSU:waq[RR UR SURSS5RSSS5USS9nUR SU5RSS5nOUn[R"U5SS2S4[X- S5-n[R"U5SSS24[X- S5-nXV- US- [X- S5--nXGR5$) aq Get relative positional embeddings according to the relative positions of query and key sizes. Args: q_size (`int`): Size of query q. k_size (`int`): Size of key k. rel_pos (`torch.Tensor`): Relative position embeddings (num_embeddings, num_channels). Returns: Extracted positional embeddings according to relative positions. r5rrr4linear)r7r8N?) r;maxr:rrArBrCrDr'arangelong)q_sizek_sizerel_pos max_rel_distrel_pos_resizedq_coordsk_coordsrelative_coordss r0 get_rel_posrk|s q3v..23L}}Q<'--33 OOAw}}Q/ 4 < bhwkzbhwc,wkc->bhwkN)rkr:rCr'einsumview)attnqueries rel_pos_h rel_pos_wrcrdqueries_height queries_width keys_height keys_widthrelative_heightrelative_width batch_size_dimr_qrelative_weights r0!add_decomposed_relative_positionsr~s,%+!N$K!.yIO IFN J3 //*m ICll#3SJOll#3SIO *m*U !Q1d* + , !Q4* + , d: 5{7OP  Kr2c:^\rSrSrSrSU4SjjrSSjrSrU=r$)VitDetAttentionz=Multi-head Attention block with relative position embeddings.c(>[TU]5 URnURnX@lX4-nUS-Ul[ R"X3S-URS9Ul [ R"X35Ul URUl UR(as[ R"[R"SUS-S- U55Ul[ R"[R"SUS-S- U55Ulgg)z Args: config (`VitDetConfig`): Model configuration. input_size (`Tuple[int]`, *optional*): Input resolution, only required in case relative position embeddings are added. gr biasr5rrN)rrrnum_attention_heads num_headsscalerLinearqkv_biasqkvproj use_relative_position_embeddingsr&r'r(rqrr)r,r- input_sizer{rhead_dimr/s r0rVitDetAttention.__init__s   .. "#t^ 99S'@IIc' 060W0W-  0 0\\%++a*Q-6G!6KX*VWDN\\%++a*Q-6G!6KX*VWDN 1r2c URup4pVURU5RX4U-SURS5R SSSSS5nURSX0R-XE-S5R S5upn XR -U RSS5-n UR(a%[XURURXE4XE45n U RSS9n X-nURX0RXES5nUR SSSSS5nURX4US5nURU5nU(a<U RX0RU RSU RS5n X4n U $U4n U $) Nr r4r5rr)r{)r:rrCrrDunbindr transposerr~rqrrsoftmaxrnr)r, hidden_stateoutput_attentionsryrGrHrzrrpkeysvaluesattention_scoresattention_probsoutputss r0rRVitDetAttention.forwards'3'9'9$ Ehh|$,,Z%DNN\^_gghiklnoqrtuv # AzNN/JFN\^ _ f fgh iv#jj0DNN2r4JJ  0 0@ 4>>4>>F?]c\k  +22r2:&/ #((^^VTVW #++Aq!Q: #++JrJ yy. -55NNO,A,A",EG\G\]_G`O$5G$oGr2)rrrrqrrrrN)F rTrUrVrWrXrrRrZr[r\s@r0rrsGX4r2rinput drop_probtrainingrNcUS:XdU(dU$SU- nURS4SURS- --nU[R"X@RUR S9-nUR 5 URU5U-nU$)a* Drop paths (Stochastic Depth) per sample (when applied in main path of residual blocks). Comment by Ross Wightman: This is the same as the DropConnect impl I created for EfficientNet, etc networks, however, the original name is misleading as 'Drop Connect' is a different form of dropout in a separate paper... See discussion: https://github.com/tensorflow/tpu/issues/494#issuecomment-532968956 ... I've opted for changing the layer and argument names to 'drop path' rather than mix DropConnect as a layer name and use 'survival rate' as the argument. rr)r)dtypedevice)r:ndimr'randrrfloor_div)rrr keep_probr: random_tensoroutputs r0 drop_pathr sCx I I [[^  Q 7 7E 5 ELL YYM YYy !M 1F Mr2c^\rSrSrSrS S\\SS4U4SjjjrS\RS\R4Sjr S\ 4S jr S r U=r$) VitDetDropPathizXDrop paths (Stochastic Depth) per sample (when applied in main path of residual blocks).NrrNc.>[TU]5 Xlgr)rrr)r,rr/s r0rVitDetDropPath.__init__!s "r2 hidden_statescB[XRUR5$r)rrr)r,rs r0rRVitDetDropPath.forward%s FFr2c8SRUR5$)Nzp={})formatrr,s r0 extra_reprVitDetDropPath.extra_repr(s}}T^^,,r2)rr)rTrUrVrWrXrfloatrr'rYrRstrrrZr[r\s@r0rrsQb#(5/#T##GU\\GellG-C--r2rc6^\rSrSrSrSU4SjjrSrSrU=r$)VitDetLayerNormi,a< A LayerNorm variant, popularized by Transformers, that performs point-wise mean and variance normalization over the channel dimension for inputs that have shape (batch_size, channels, height, width). https://github.com/facebookresearch/ConvNeXt/blob/d1fa8f6fef0a165b27399986cc2bdacc92777e40/models/convnext.py#L119 c>[TU]5 [R"[R "U55Ul[R"[R"U55UlX l U4Ul gr) rrrr&r'onesweightr(repsnormalized_shape)r,rrr/s r0rVitDetLayerNorm.__init__3sR ll5::.>#?@ LL-=!>? !1 3r2cURSSS9nX- RS5RSSS9nX- [R"X0R-5- nUR SS2SS4U-UR SS2SS4-nU$)NrT)keepdimr5)meanpowr'r=rrr)r,xuss r0rRVitDetLayerNorm.forward:s FF1dF # UKKN  4  0 UejjXX. . KK4 & *TYYq$}-E Er2)rrrr)gư>rr\s@r0rr,s 4r2rc2^\rSrSrSrU4SjrSrSrU=r$)VitDetResBottleneckBlockiBz The standard bottleneck residual block without the last activation layer. It contains 3 conv layers with kernels 1x1, 3x3, 1x1. c>[TU]5 [R"X$SSS9Ul[ U5Ul[URUl [R"XDSSSS9Ul [ U5Ul [URUl [R"XCSSS9Ul [ U5Ulg)a" Args: config (`VitDetConfig`): Model configuration. in_channels (`int`): Number of input channels. out_channels (`int`): Number of output channels. bottleneck_channels (`int`): Number of output channels for the 3x3 "bottleneck" conv layers. rFrr )paddingrN)rrrr*conv1rnorm1r hidden_actact1conv2norm2act2conv3norm3)r,r- in_channels out_channelsbottleneck_channelsr/s r0r!VitDetResBottleneckBlock.__init__Hs YY{O $%89 6,,- YY2TU\ab $%89 6,,- YY2!%P $\2 r2cPUnUR5H nU"U5nM X-nU$r)children)r,routlayers r0rR VitDetResBottleneckBlock.forward`s.]]_E*C%g r2)rrrrrrrrrr\s@r0rrBs 30r2rcr^\rSrSrS\S\SS4U4SjjrS\RS\R4SjrS r U=r $) VitDetMlpii in_featureshidden_featuresrNNc>[TU]5 [R"X#5Ul[ UR Ul[R"X25Ul[R"UR5Ul gr) rrrrfc1r ractfc2Dropout dropout_probdrop)r,r-rrr/s r0rVitDetMlp.__init__jsV 99[:&++,99_:JJv223 r2rcURU5nURU5nURU5nURU5nURU5nU$r)rrrr)r,rs r0rRVitDetMlp.forwardqsH HHQK HHQK IIaL HHQK IIaLr2)rrrr) rTrUrVrWr;rr'rYrRrZr[r\s@r0rris=4C4#4$4%,,r2rc HURup#pEXU-- U-nXU-- U-n[RRUSSSUSU45nX6-XG-pUR X(U-XU-X5nUR SSSSSS5R 5R SXU5n XU 44$)a Partition into non-overlapping windows with padding if needed. Args: hidden_state (`torch.Tensor`): Input tokens with [batch_size, height, width, num_channels]. window_size (`int`): Window size. Returns: `tuple(torch.FloatTensor)` comprising various elements: - windows: windows after partition with [batch_size * num_windows, window_size, window_size, num_channels]. - (padded_height, padded_width): padded height and width before partition rrr r5rr4)r:rrApadrnrD contiguous) r window_sizeryrGrHr pad_height pad_width padded_height padded_widthwindowss r0window_partitionr{s/;.@.@+J 44 CJ{22kAI==$$\Aq!Y:3VWL"("5u7H<$$[0+{?Z\gL""1aAq!4??AFFr;eqrG L1 11r2c(UupEUupgURSXE-U-U--nURXU-XQ-XS5n U RSSSSSS5R5n U RXUS5n U SS2SU2SU2SS24R5n U $) a Window unpartition into original sequences and removing padding. Args: windows (`torch.Tensor`): Input tokens with [batch_size * num_windows, window_size, window_size, num_channels]. window_size (`int`): Window size. pad_height_width (`Tuple[int]`): Padded height and width (padded_height, padded_width). height_width (`Tuple[int]`): Original height and width before padding. Returns: hidden_state: unpartitioned sequences with [batch_size, height, width, num_channels]. rr4rr r5rrN)r:rnrDr) rrpad_height_width height_widthrrrGrHryrs r0window_unpartitionrs"#3M MFq!m&Bk&QU`&`aJ<<[0,2M{ikL ''1aAq9DDFL$$Z bQL 7F7FUFA 56AACL r2c ^\rSrSrSrSS\S\S\S\SS4 U4S jjjr SS \ RS \ \ RS \S\ \\ R\ R4\\ R44S jjrSrU=r$) VitDetLayerizCThis corresponds to the Block class in the original implementation.r-drop_path_rateruse_residual_blockrNNc>[T U]5 URnURn[ U[ [ 45(aUOXf4nURn[ U[ [ 45(aUOXw4nUSUS-USUS-4n[R"XQRS9Ul [XS:XaUOX34S9Ul US:a [U5O[R"5Ul[R"XQRS9Ul[%X['XQR(-5S9UlX0lX@lUR.(a[1UUUUS-S9Ulgg) Nrr)r)rr)r-rrr5)r-rrr)rrrr#rlisttuplerr LayerNormlayer_norm_epsrr attentionrIdentityrrrr; mlp_ratiomlprrrresidual) r,r-rrrr{r#rrr/s r0rVitDetLayer.__init__sF   && #-j4-#H#HZzNf && #-j4-#H#HZzNf  mz!}4jmzRS}6TU \\#+@+@A ( A-=zKC] }N^N^._ +M!% /"0" /q1 (,   a .}>N>NP`cikpbqrM!>>-#@@ %txx =@Y7Z([[ %--aAq9  " " MM-8M "W,r2)r rr rrr rr)rrF)NF)rTrUrVrWrXrrr;boolrr'rYrrrrRrZr[r\s@r0rrsMqv!"!49!LO!im! !!L-1"' (||(ELL)( ( uU\\5<</0% 2EE F ((r2rc^\rSrSrS\SS4U4SjjrS S\RS\\RS\ S \ S \ S\ \ \ 44 S jjr S rU=r$) VitDetEncoderi r-rNNc >[TU]5 XlURn[R "SUR USS9Vs/sHo3R5PM nn/n[U5HGnUR[UXFXaR;a UROSXaR;S95 MI [R"U5UlSUlgs snf)Nrcpu)r)rrrF)rrr-num_hidden_layersr'linspaceritemrangeappendrwindow_block_indicesrresidual_block_indicesr ModuleListrgradient_checkpointing)r,r-depthrrlayersir/s r0rVitDetEncoder.__init__ s  ((-2NN1f>S>SUZch,ij,iq&&(,ijuA MM#1#467;V;V6V 2 2\]'(,I,I'I  ]]6* &+#ksCrrroutput_hidden_states return_dictcU(aSOSnU(aSOSn[UR5HzupU(aXa4-nUbX(OSn UR(a0UR(aUR U R UU U5n O U "XU5n U SnU(dMrX{S4-nM| U(aXa4-nU(d[ SXU455$[UUUS9$)Nrrc3.# UH ocMUv M g7frr)).0vs r0 (VitDetEncoder.forward..Fsm$[q$[s last_hidden_stater attentions) enumeraterr!r_gradient_checkpointing_func__call__rr ) r,rrrr&r'all_hidden_statesall_self_attentionsr$ layer_modulelayer_head_mask layer_outputss r0rRVitDetEncoder.forward"s#7BD$5b4(4OA#$58H$H!.7.CilO**t}} $ A A ))!#% ! !-]M^ _ )!,M  &91=MR RR5 UR>RRR5 gg)zInitialize the weightsr)rstdNr_) rrrr*r@ trunc_normal_rdatator'float32r-initializer_rangerrzero_rfill_rr)rrrqrrrrrrrCrrr)r,r;rs r0 _init_weights#VitDetPreTrainedModel._init_weightsds fryy"))4 5 5"$!6!6 ""%%emm43DKKDaDa"7"b$$% MM {{&   &&('  - - KK   " " $ MM   $ $S )  0 1 1.0gg.C.C**//225==AKK11/D/b++112  & & +  0 0T[[5a5a$&GG$9$9  %%((7KK11%:%F   ! %'GG$9$9  %%((7KK11%:%F   !  8 9 9 ,, fllC 'D ,, 5 !!'', %%'6 LL   $ $ * * , LL   " " ( ( *:r2r))rTrUrVrWr config_classbase_model_prefixmain_input_namesupports_gradient_checkpointing_no_split_modulesrrrr*rrPrZr)r2r0rErE\sJL $O&*#)+E"))RYY *L$M)+RV)+r2rEc^\rSrSrS\4U4SjjrS\4SjrS\\ \ \ 4SS4Sjr \ SS \ \RS \ \RS \ \S \ \S \ \S\\\44 Sjj5rSrU=r$) VitDetModelir-c>[TU]U5 Xl[U5Ul[ U5UlUR5 gr)rrr-rrQrencoder post_init)r,r-r/s r0rVitDetModel.__init__s9   *62$V,  r2rNc.URR$rrQr+rs r0get_input_embeddings VitDetModel.get_input_embeddings)))r2heads_to_pruneNcUR5H7up#URRURR U5 M9 g)z Prunes heads of the model. heads_to_prune: dict of {layer_num: list of heads to prune in this layer} See base class PreTrainedModel N)itemsrZrr  prune_heads)r,rbrheadss r0 _prune_headsVitDetModel._prune_headss< +002LE LL  u % / / ; ;E B3r2rMrrr&r'cUbUOURRnUbUOURRnUbUOURRnUc [ S5eUR X RR 5nURU5nURUUUUUS9nUSnU(d U4USS-$[UURURS9$)aw Examples: ```python >>> from transformers import VitDetConfig, VitDetModel >>> import torch >>> config = VitDetConfig() >>> model = VitDetModel(config) >>> pixel_values = torch.randn(1, 3, 224, 224) >>> with torch.no_grad(): ... outputs = model(pixel_values) >>> last_hidden_states = outputs.last_hidden_state >>> list(last_hidden_states.shape) [1, 768, 14, 14] ```Nz You have to specify pixel_values)rrr&r'rrr/) r-rr&use_return_dictr> get_head_maskrrQrZr rr1) r,rMrrr&r'embedding_outputencoder_outputssequence_outputs r0rRVitDetModel.forwards82C1N-TXT_T_TqTq$8$D $++JjJj &1% = 'tn = d^ =  uo% &= = r2rXzF ViTDet backbone, to be used with frameworks like Mask R-CNN. ) custom_introc ^\rSrSrU4SjrS\4Sjr\S S\RS\ \ S\ \ S\ \ S\ 4 S jj5r S rU=r$) VitDetBackboneic>[TU]U5 [TU] U5 [U5Ul[ U5Ul[URS-5Vs/sHo!RPM snUl UR5 gs snf)Nr) rr_init_backbonerrQrrZrrr num_featuresr[)r,r-rzr/s r0rVitDetBackbone.__init__su   v&*62$V, 9>v?W?WZ[?[9\]9\A//9\] ^sBrNc.URR$rr^rs r0r_#VitDetBackbone.get_input_embeddingsrar2rMr&rr'c UbUOURRnUbUOURRnUbUOURRnUR U5nUR USUUS9nU(a UR OUSnSn[URU5HupXR;dMX4- nM U(dU(a U4USS-n U $U4USS-n U $[UU(a UR OSURS9$)ap Examples: ```python >>> from transformers import VitDetConfig, VitDetBackbone >>> import torch >>> config = VitDetConfig() >>> model = VitDetBackbone(config) >>> pixel_values = torch.randn(1, 3, 224, 224) >>> with torch.no_grad(): ... outputs = model(pixel_values) >>> feature_maps = outputs.feature_maps >>> list(feature_maps[-1].shape) [1, 768, 14, 14] ```NT)r&rr'rr)r5) feature_mapsrr1) r-rjr&rrQrZrzip stage_names out_featuresr r1) r,rMr&rr'rlrrrzstagerrs r0rRVitDetBackbone.forwards+6&1% ; d^ ;  ; ; r2rr)rXrErr)rF)6rXcollections.abcr r<typingrrrrrr'torch.utils.checkpointr activationsr modeling_outputsr r modeling_utilsr utilsrrutils.backbone_utilsrconfiguration_vitdetr get_loggerrTloggerModulerr?script_if_tracingrkr~rrYrrrrrrrrrrrrCrErXrr__all__r)r2r0rs 55 !?-,1.   H %UryyUp!3!3H&R;bii;~U\\eTV[VbVb* -RYY -bii,$ryy$N $2@>N"))Nb@ BII@ F *RYY *4 *0+O0+0+fT 'T T n K *MK  K \ Er2