eThWhSSKJrJr SSKJrJrJr SSKJrJ r J r SSK J r SSK Jr SSKJrJrJr SS KJr SS KJr SS KJr SS KJr S r\ R>"S5r S\4Sjr!"SS\5r""SS\5r#"SS\5r$"SS\5r%"SS\5r&g!\\4a \rSrSrNbf=f))ArgumentParser Namespace)AnyListOptional)Pipelineget_supported_taskspipeline)logging)BaseTransformersCLICommand)BodyFastAPI HTTPException)APIRoute) BaseModel) JSONResponse)runTcg)N)xys U/var/www/auris/envauris/lib/python3.13/site-packages/transformers/commands/serving.pyrr"s Fztransformers/servingargsc[URUR(a UROSURURUR S9n[ XRURUR5$)zr Factory function used to instantiate serving server from provided command line arguments. Returns: ServeCommand N)taskmodelconfig tokenizerdevice) r rrr r!r" ServeCommandhostportworkers)rnlps rserve_command_factoryr(+sV  YY JJdjjD{{..{{  C YY 4<< @@rc$\rSrSr%Sr\\S'Srg)ServeModelInfoResult;z Expose model information infosrN)__name__ __module__ __qualname____firstlineno____doc__dict__annotations____static_attributes__rrrr*r*;s Krr*c@\rSrSr%Sr\\\S'\\\ \S'Sr g)ServeTokenizeResultCz Tokenize result model tokens tokens_idsrN) r-r.r/r0r1rstrr3rintr4rrrr6r6Cs" Ic##rr6c$\rSrSr%Sr\\S'Srg)ServeDeTokenizeResultLz DeTokenize result model textrN)r-r.r/r0r1r:r3r4rrrr=r=Ls Irr=c$\rSrSr%Sr\\S'Srg)ServeForwardResultTz Forward result model outputrN)r-r.r/r0r1rr3r4rrrrArATs KrrAc\rSrSr\S\4Sj5rS\S\S\ S\ 4Sjr S r S r \ "S S S 9\ "SS S 94S\S\4Sjjr\ "S S S 9\ "SS S 9\ "S S S 94S\\ S\S\4Sjjr\ "S S S 94SjrSrg )r#\parsercURSSS9nURS[[5SS9 URS[SS S 9 URS [S S S 9 URS[SSS 9 URS[SS9 URS[SS9 URS[SS9 URS[SSS 9 UR [ S9 g)z Register this command to argparse so it's available for the transformer-cli Args: parser: Root parser to register command-specific arguments servezFCLI tool to run inference requests through REST and GraphQL endpoints.)helpz--taskzThe task to run the pipeline on)typechoicesrIz--host localhostz$Interface the server will listen on.)rJdefaultrIz--porti"z Port the serving will listen to.z --workersr zNumber of http workersz--modelz%Model's name or path to stored model.)rJrIz--configz,Model's config name or path to stored model.z --tokenizerzTokenizer name to use.z--devicezSIndicate the device to run onto, -1 indicates CPU, >= 0 indicates GPU (default: -1))funcN) add_parser add_argumentr:r r; set_defaultsr()rF serve_parsers rregister_subcommand ServeCommand.register_subcommand]s(( b)  !! ')2 " !!(kPv!w!!(dIk!l!!+CIa!b!!)# > 8^^F+F%V4 4 8gs1v%67 7 8s%A 7A  AAAA )rir`r$r%r&)r-r.r/r0 staticmethodrrTr r:r;rkrrerboolrfrrgrhr4rrrr#r#\s>N>>rs/&&??(*44("0$(!   2 3 A A 9$)$IH8-H8{ ^$*I %*! *s$BB10B1