eThRSrSSKJrJrJr \"5(aSSKJr SSjrg)z7SpQR (Sparse-Quantized Representation) integration file)is_accelerate_availableis_spqr_availableis_torch_availableNcdUc/n[5(aSSKJn [5(aSSKJn UR 5GHupxUc/nURU5 [U[R5(GaVSRU5S-U;Ga<W"5 SRU5n URn U R5n U S3U ;=(a& U S3U ;=(a U S 3U ;=(a U S 3U ;n U (d[S U S 35eXS3n XS3nXS 3nXS 3nURnUR nWR#UUUR$UR&UR(U UUUS 9 UR*U'Sn[-U5UR*UlUR*UR1S5 SSS5 O[3[5UR7555S:a[9UUUUUS9unnUR;S5 GM X4$!,(df  N]=f)a" Public method that recursively replaces the Linear layers of the given model with SpQR quantized layers. `accelerate` is needed to use this method. Returns the converted model and a boolean that indicates if the conversion has been successful or not. Args: model (`torch.nn.Module`): The model to convert, can be any `torch.nn.Module` instance. quantization_config (`SpQRConfig`): The quantization config object that contains the quantization parameters. modules_to_not_convert (`list[str]`, *optional*): A list of nn.Linear weights to not convert. If a parameter path is in the list (e.g. `lm_head.weight`), the corresponding module will not be converted. current_key_name (`list`, *optional*): A list that contains the current key name. This is used for recursion and should not be passed by the user. has_been_replaced (`bool`, *optional*): A boolean that indicates if the conversion has been successful or not. This is used for recursion and should not be passed by the user. Nr)init_empty_weights)QuantizedLinear.z.weightz.dense_weights.shapez.row_offsets.shapez.col_vals.shapez.in_perm.shapezJThe SpQR quantization config does not contain the shape configuration for zG. This indicates that the configuration is either invalid or corrupted.) rowscolsbitsbeta1beta2dense_weights_shaperow_offsets_shapecol_vals_shape in_perm_shapeTF)quantization_configmodules_to_not_convertcurrent_key_namehas_been_replaced)r acceleraterr spqr_quantr named_childrenappend isinstancennLinearjoinshapeskeys ValueError in_features out_featurescreate_placehodlerr rr_modulestype source_clsrequires_grad_lenlistchildrenreplace_with_spqr_linearpop)modelrrrrrr namemodule tensor_namer! shapes_keys shapes_validrrrrr$r%_s V/var/www/auris/envauris/lib/python3.13/site-packages/transformers/integrations/spqr.pyr.r.st4%!#  1.,,.   #! % fbii ( (xx()I5=SS')"%((+;"+MJ*m?;{JJ +m>:kI !((11< >LM +1=@T1U*V'(.>P/Q(R%%+m?,K%LN$*].+I$JM"("4"4K#)#6#6L+:+M+M)(055177177,?*;'5&3,N ,ENN4()-%7;6lENN4(3NN4(77>Y*)\ tFOO%& '! +#;$7'=!1"3 $ A  R A/B  ##s*)s D,H!! H/ )NNNF)__doc__utilsrrrtorch.nnrr.r7r=s2:RR  c$r<