eTh>SrSSKJr SSKJr SSKJr SSjrg)z9VPTQ (Vector Post-Training Quantization) integration fileN)init_empty_weights) VQuantLinearclU(dS/OUnUR5GHupVUc/nURU5 SRU5nURnURn [ U[ R5(aXr;aXy;d USU;aU RUS5=(d URUSS5n [5 URn URn [U U U SU SU SU SU S U S U S U S U S SSURSLS9URU'SnURURS5 SSS5 [![#UR%555S:a['UUUUUS9upUR)S5 GM X4$!,(df  N\=f)a3 Public method that recursively replaces the Linear layers of the given model with VPTQ quantized layers. `accelerate` is needed to use this method. Returns the converted model and a boolean that indicates if the conversion has been successful or not. Args: model (`torch.nn.Module`): The model to convert, can be any `torch.nn.Module` instance. quantization_config (`VptqConfig`): The quantization config object that contains the quantization parameters. modules_to_not_convert (`List[`str`]`, *optional*, defaults to `["lm_head"]`): Names of the modules to not convert in `VQuantLinear`. In practice we keep the `lm_head` in full precision for numerical stability reasons. current_key_name (`list`, *optional*): A list that contains the current key name. This is used for recursion and should not be passed by the user. has_been_replaced (`bool`, *optional*): A boolean that indicates if the conversion has been successful or not. This is used for recursion and should not be passed by the user. lm_headN. vector_lens num_centroidsnum_res_centroids group_num group_size outlier_sizeindices_as_float enable_norm enable_permTF) r r r r r rrrris_indice_packedenable_proxy_errorbiasr)quantization_configmodules_to_not_convertcurrent_key_namehas_been_replaced)named_childrenappendjoinshared_layer_configconfig_for_layers isinstancennLineargetr in_features out_featuresrr_modulesrequires_grad_lenlistchildrenreplace_with_vptq_linearpop)modelrrrrnamemodule layer_namerr layer_paramsr"r#_s V/var/www/auris/envauris/lib/python3.13/site-packages/transformers/integrations/vptq.pyr)r)s61Gi[Lb,,.   #! %XX./ 1EE/AA vryy ) )817G7KOb7b,00TBFYF]F] $dGL$%$00 %22 '3 ,] ;"."?&23F&G*;7+L9!-n!=%12D%E ,] ; ,] ;%)',D0(t$ %)!t$33E:/&0 tFOO%& '! +#;$7'=!1"3 $ A R e/f  ##E&%s BF%% F3 )NNNF)__doc__torch.nnr acceleratervptqrr)r1r8s'<)  P$r7