fThTSSKrSSKrSSKrSSKrSSKJr SSKJr SSKJr SSKJ r SSK J r J r J r JrJrJrJr SSKJr SS KJr SS KJrJrJr \R4"\5r\"5(aSSKrSS KJr SS K J!r! OSr\"5(aSS K"J#r# \"5(aSSK$J%r% \&\'\(\)\ \*"S5S4r+\RX"S\RZ5r.\RX"S\RZ5r/\RX"S\RZ\R`-5r1\RX"S\RZ5r2"SS\35r4"SS\35r5S\(S\6\(\(44Sjr7S\(S\64Sjr8S\ S\64Sjr9S\(S\:\ \(\ \6\ \(44S jr;S\ S\64S!jrS,S$\?\?\6\(\(4S%\ \?\\6\ 4S&\ \?\6\(\(4S'\ \(S(\ \)S)\ \)S*\ \)S\(4S+jjr@g)-N)contextmanager)datetime) lru_cache) isfunction)AnyCallableOptionalUnionget_args get_originget_type_hints)version)logging)is_jinja_availableis_torch_availableis_vision_available) Extension)ImmutableSandboxedEnvironment)Image)Tensor.z(^(.*?)[\n\s]*(Args:|Returns:|Raises:|\Z)z0\n\s*Args:\n\s*(.*?)[\n\s]*(Returns:|Raises:|\Z)a1 (?:^|\n) # Match the start of the args block, or a newline \s*(\w+):\s* # Capture the argument name and strip spacing (.*?)\s* # Capture the argument description, which can span multiple lines, and strip trailing spacing (?=\n\s*\w+:|\Z) # Stop when you hit the next argument or the end of the block z*\n\s*Returns:\n\s*(.*?)[\n\s]*(Raises:|\Z)c\rSrSrSrSrg)TypeHintParsingExceptionBzJException raised for errors in parsing type hints to generate JSON schemasN__name__ __module__ __qualname____firstlineno____doc____static_attributes__r^/var/www/auris/envauris/lib/python3.13/site-packages/transformers/utils/chat_template_utils.pyrrBTr#rc\rSrSrSrSrg)DocstringParsingExceptionHzJException raised for errors in parsing docstrings to generate JSON schemasrNrrr#r$r'r'Hr%r#r' param_typereturnc [SS0[SS0[SS0[SS0[ S5SS0[ 00n[ 5(a SS0U['[5(a SS0U['URUSS 05$) Ntypeintegernumberstringbooleannullimageaudioobject) intfloatstrboolr,rrrrrget)r) type_mappings r$_get_json_schema_typer;Ns fi  ! fh  vy! T VV$ R L%w/ U &0 V   J(: ;;r#hintc[U5n[U5nUc [U5$U[ Ld([ [S5(aU[RLaUVs/sHo3[S5LdM[U5PM nn[U5S:XaUSnO<[SU55(a!S[UVs/sHofSPM sn50nOSU0n[S5U;aSUS 'U$U[LaU(dSS 0$S [US5S .$U[LarU(dSS 0$[U5S:Xa([ S [!U5R#S S5S35eSU;a [ S5eS UVs/sHn[U5PM snS.$U[$La&SS0n[U5S:Xa[US5US'U$[ SU5e![a [ SU5ef=fs snfs snfs snf)NzGCouldn't parse this type hint, likely due to a custom class or object: UnionTyperrc3H# UHn[US[5v M g7f)r,N) isinstancer7).0subtypes r$ #_parse_type_hint..psJgGFOS11s "r,anyOfTnullablearray)r,itemszThe type hint ztyping.a1 is a Tuple with a single element, which we do not automatically convert to JSON schema as it is rarely necessary. If this input can contain more than one element, we recommend using a List[] type instead, or if it really is a single element, remove the Tuple[] wrapper and just pass the element directly..znConversion of '...' is not supported in Tuple type hints. Use List[] types for variable-length inputs instead.)r, prefixItemsr4additionalProperties)r r r;KeyErrorrr hasattrtypesr>r,_parse_type_hintlenallsortedlisttupler7replacedict)r<originargstsubtypes return_dictrBouts r$rPrP^s  F D>D ~ (. . 5WUK88Vu=V15MA$t*9L'$Q'M x=A "1+K JJ J J!6(*S(w6?(*S#TUK#H-K : &*K # 4G$ $$.>tAw.GH H 5G$ $ t9>* T!2!29b!A BC--  $;*#   d0Sd1A!1Dd0STT 4x  t9>*:47*CC& ' "#lnr sso *Y[_  N +T@1Ts# GG0G7G" .G'Gfuncc[U5n[R"U5n/nURR 5HupEUR [R R:Xa%[SURSUR35eUR[R R:XdM|URU5 M 0nUR 5HupG[U5Xd'M SUS.nU(aX8S'U$)Nz Argument z$ is missing a type hint in function r4)r, propertiesrequired)r inspect signature parametersrH annotation ParameteremptyrnamerdefaultappendrP) r^ type_hintsrcra param_nameparamr`r)schemas r$"_convert_type_hints_to_json_schemaros%J!!$'IH&11779   w0066 6*YuzzlBfgkgtgtfu+vw w ==G--33 3 OOJ ' : J","2"2"4 !1*!= #5j 9F%z Mr# docstringc [RU5n[RU5n[RU5nU(aUR S5R 5OSnU(aUR S5R 5OSnU(aUR S5R 5OSnUbSR URS5Vs/sHowR 5(dMUPM sn5n[RU5nUV s0sH/oS[R"SSU SR 55_M1 n n O0n XJU4$s snfs sn f)z Parses a Google-style docstring to extract the function description, argument descriptions, and return description. Args: docstring (str): The docstring to parse. Returns: The function description, arguments, and return description. rN rz \s*\n+\s* ) description_researchargs_re returns_regroupstripjoinsplit args_split_refindallresub) rpdescription_match args_match returns_match descriptiondocstring_argsreturnslinematchesmatch args_dicts r$parse_google_format_docstringrs)'--i8 *J%%i0M9J#))!,224tK4>Z%%a(..0DN0=m!!!$**,4G!^5I5I$5O#`5OTS]S]S_D5O#`a''7X_`X_u1XrvvlCq9IJJX_ `  7 ** $a`sE5E6Ec[R"U5nU(d[SURS35eUR 5n[ U5up#n[ U5nUSRSS5=nbUbXFS'USR5HupxXs;a[SURSUS35eX7n [R"S U [RS 9n U (aq[R"U RS 55V s/sHoR 5PM sn US 'U RSU R!5R 5n XS'M URX%S .n UbXlS'SU S.$s sn f)ax This function generates a JSON schema for a given function, based on its docstring and type hints. This is mostly used for passing lists of tools to a chat template. The JSON schema contains the name and description of the function, as well as the names, types and descriptions for each of its arguments. `get_json_schema()` requires that the function has a docstring, and that each argument has a description in the docstring, in the standard Google docstring format shown below. It also requires that all the function arguments have a valid Python type hint. Although it is not required, a `Returns` block can also be added, which will be included in the schema. This is optional because most chat templates ignore the return value of the function. Args: func: The function to generate a JSON schema for. Returns: A dictionary containing the JSON schema for the function. Examples: ```python >>> def multiply(x: float, y: float): >>> ''' >>> A function that multiplies two numbers >>> >>> Args: >>> x: The first number to multiply >>> y: The second number to multiply >>> ''' >>> return x * y >>> >>> print(get_json_schema(multiply)) { "name": "multiply", "description": "A function that multiplies two numbers", "parameters": { "type": "object", "properties": { "x": {"type": "number", "description": "The first number to multiply"}, "y": {"type": "number", "description": "The second number to multiply"} }, "required": ["x", "y"] } } ``` The general use for these schemas is that they are used to generate tool descriptions for chat templates that support them, like so: ```python >>> from transformers import AutoTokenizer >>> from transformers.utils import get_json_schema >>> >>> def multiply(x: float, y: float): >>> ''' >>> A function that multiplies two numbers >>> >>> Args: >>> x: The first number to multiply >>> y: The second number to multiply >>> return x * y >>> ''' >>> >>> multiply_schema = get_json_schema(multiply) >>> tokenizer = AutoTokenizer.from_pretrained("CohereForAI/c4ai-command-r-v01") >>> messages = [{"role": "user", "content": "What is 179 x 4571?"}] >>> formatted_chat = tokenizer.apply_chat_template( >>> messages, >>> tools=[multiply_schema], >>> chat_template="tool_use", >>> return_dict=True, >>> return_tensors="pt", >>> add_generation_prompt=True >>> ) >>> # The formatted chat can now be passed to model.generate() ``` Each argument description can also have an optional `(choices: ...)` block at the end, such as `(choices: ["tea", "coffee"])`, which will be parsed into an `enum` field in the schema. Note that this will only be parsed correctly if it is at the end of the line: ```python >>> def drink_beverage(beverage: str): >>> ''' >>> A function that drinks a beverage >>> >>> Args: >>> beverage: The beverage to drink (choices: ["tea", "coffee"]) >>> ''' >>> pass >>> >>> print(get_json_schema(drink_beverage)) ``` { 'name': 'drink_beverage', 'description': 'A function that drinks a beverage', 'parameters': { 'type': 'object', 'properties': { 'beverage': { 'type': 'string', 'enum': ['tea', 'coffee'], 'description': 'The beverage to drink' } }, 'required': ['beverage'] } } z Cannot generate JSON schema for z because it has no docstring!r`r*Nrz< because the docstring has no description for the argument ''z\(choices:\s*(.*?)\)\s*$)flagsrenum)rhrrdfunction)r,r)rbgetdocr'rryrropoprHr~ru IGNORECASEjsonloadsrxr/start) r^docmain_docparam_descriptions return_doc json_schemar\argrndesc enum_choicescoutputs r$get_json_schemarsV .. C '.t}}o=Z [   ))+C/LS/Q,H*4T:K"<044XtDD Q  !)3 &"<0668   (+24==/A}B~CCDE "&yy!DDFD $}9mmH XF&xF 33TsE;c /n/nURRXg5 UR"SUUUUS.UD6HnURU5 M SR U5n SSS5 X4$!,(df  W U4$=f)Nmessagestools documentsadd_generation_promptrIr) environmentactivate_trackergeneraterjrz) compiled_templaterrrrtemplate_kwargsrendered_blocksgeneration_indicesblock rendered_chats r$_render_with_assistant_indicesr^sO  & & 7 7 \&// "7    E  " "5 ) 0  ]  ,, ] \ , ,,s AA,, A=c[5(d [S5e"SS[5n[R"[ R 5[R"S5:a[S[ R S35eSnSSjnS n[S S U[ RR/S 9nX5RS 'X%RS 'XERS'URU5$)Nzbapply_chat_template requires jinja2 to be installed. Please install it using `pip install jinja2`.cR^\rSrSrS1rS\4U4SjjrS\RRS\RR4Sjr \RS\RRS \RR S\4S j5rS\4S jr\S \\S \\4Sj5rSrU=r$)1_compile_jinja_template..AssistantTrackeriw generationrcr>[TU]U5 URURS9 SUlSUlg)N)r)super__init__extendr_rendered_blocks_generation_indices)selfr __class__s r$r:_compile_jinja_template..AssistantTracker.__init__{s7 G [ )   0E0E  F$(D !'+D $r#parserr*c[UR5RnURS/SS9n[R R URS5//U5RU5$)Nzname:endgenerationT) drop_needle_generation_support) nextstreamlinenoparse_statementsjinja2nodes CallBlock call_method set_lineno)rrrbodys r$parse7_compile_jinja_template..AssistantTracker.parsese&--(//F**,@+At*TD<<))$*:*:;P*QSUWY[_`kklrs sr#contextcallercU"5nUR5(aN[SRUR55nU[U5-nURR XE45 U$)NrI) is_activerQrzrrrj)rrrrv start_index end_indexs r$rE_compile_jinja_template..AssistantTracker._generation_supportsYB~~!"''$*?*?"@A '#b'1 ((//0HIIr#c@UR=(d UR$N)rr)rs r$r;_compile_jinja_template..AssistantTracker.is_actives((DD,D,D Dr#rrc3# UR5(a [S5eXlX lSv SUlSUlg!SUlSUlf=f7f)Nz3AssistantTracker should not be reused before closed)r ValueErrorrr)rrrs r$rB_compile_jinja_template..AssistantTracker.activate_trackersU 0>>##$%Z[[(7%+=((,%+/()-%+/(sA0AAAA)rr)rrrr tagsrrrrParserrrrpass_eval_context EvalContextruntimeMacror7rr8rrrTr5rr" __classcell__)rs@r$AssistantTrackerrws~ ,(E , t 4 4 t9O9O t  ! ! v||/G/G QWQ_Q_QeQe jm  "  Et E  0DI 0SWX[S\ 0  0r#rz3.1.0zLapply_chat_template requires jinja2>=3.1.0 to be installed. Your version is .c@[RRU5er)r exceptions TemplateError)messages r$raise_exception0_compile_jinja_template..raise_exceptions--g66r#c.[R"XX#US9$)N) ensure_asciiindent separators sort_keys)rdumps)xrrrrs r$tojson'_compile_jinja_template..tojsonszz!vhqrrr#cJ[R"5RU5$r)rnowstrftime)formats r$ strftime_now-_compile_jinja_template..strftime_nows||~&&v..r#T) trim_blocks lstrip_blocks extensionsrrr)FNNF) r ImportErrorrrrr __version__rext loopcontrolsfiltersglobals from_string) chat_templaterrrr jinja_envs r$_compile_jinja_templaterps    p  (09(0T}}V''(7==+AAZ[a[m[mZnno p  7s /.:JFJJLcLc9dI#)h+:'((4n%   //r# conversationsrrrreturn_assistant_tokens_maskcontinue_final_messagerc U(a1[R"SU5(d[RS5 [ U5nUbi/n UH`n [ U [ 5(aU RU 5 M+[U 5(aU R[U 55 MW[S5e OSn Ub)UH#n [ U [ 5(aM[S5e /n /n UGHjn[US5(a URnU(a&[S UUU UUS.UD6unnU RU5 OUR"S UU UUS.UD6nU(aUSS n[ U[ ["45(a*[%U5HnS U;dM US n O [S 5eUR'5U;a [S 5eUR)UR'55nUUU[+UR-55-U:Xa USU[+UR-55-nOUSU[+UR'55-nU RU5 GMm X4$)Nz\{\%-?\s*generation\s*-?\%\}zareturn_assistant_tokens_mask==True but chat template does not contain `{% generation %}` keyword.zTools should either be a JSON schema, or a callable function with type hints and a docstring suitable for auto-conversion to a schema.zADocuments should be a list of dicts with 'title' and 'text' keys!r)rrrrrrcontenttextz]continue_final_message is set but we could not find any text to continuein the final message!acontinue_final_message is set but the final message does not appear in the chat after applying the chat template! This can happen if the chat template deletes portions of the final message. Please verify the chat template and final message in your chat to ensure they are compatible.r)r~rulogger warning_oncerr@rWrjrrr TypeErrorrNrrrenderrTrUreversedryrindexrQlstrip)rrrrrr rkwargsr tool_schemastooldocumentrenderedall_generation_indiceschatrr final_message content_block final_msg_locs r$render_jinja_templaters|$BII6UWd,e,e o 0 >  D$%%##D)D!!##OD$9: P  !Hh-- cdd"H 4 $ $==D '0N1"3"#&; 1  1 -M- # ) )*< =-44"#&;   M " HY/M-$77%-m%r/sj %WWWUU   H %$< FE3c4:s; GS **H")) T  II  ZZEryy Q  y   t3>t4>tBX$*+S+U8C=(SW.ZbcfZg;g5h+BF4(F4tF4R-$ F0 F0V4804#'38-2,1[,T#s(^,-[, DtX~./ 0[,T#s(^,-[,C= [, #+4. [, %TN [,$D>[, [,r#