o )iA1@s0dZddlZddlZddlZddlmZddlmZddlm Z m Z m Z ddl m Z ddlmZddlmZddlmZmZdd lmZmZdd lmZmZdd lmZdd lmZdd lm Z ddl!m"Z"e e#Z$Gdddej%Z&ee GdddZ'de"de"fddZ(dej)fddZ*de"fddZ+dS)z This file contains the command line arguments for the vLLM's OpenAI-compatible server. It is kept in a separate file for documentation purposes. N)Sequence)field)LiteralOptionalUnion) dataclass)config)AsyncEngineArgs optional_type)ChatTemplateContentFormatOptionvalidate_chat_template)H11_MAX_HEADER_COUNT_DEFAULT%H11_MAX_INCOMPLETE_EVENT_SIZE_DEFAULT)LoRAModulePath)ToolParserManager) init_logger)FlexibleArgumentParserc @sBeZdZ ddejdejdeeee efdeefddZ dS) LoRAParserActionNparser namespacevalues option_stringc Cs|durg}t|trtdg}|D]b}|dvrqd|vr2d|vr2|d\}}|t||qzt|} tdi| } || WqtjyW| d|Yqtyu} z| d|dt| WYd} ~ qd} ~ wwt ||j |dS) NzExpected values to be a list)N=,z(Invalid JSON format for --lora-modules: z#Invalid fields for --lora-modules: z - ) isinstancestr TypeErrorsplitappendrjsonloadsJSONDecodeErrorerrorsetattrdest) selfrrrrZ lora_listitemnamepathZ lora_dictZloraerrl/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/vllm/entrypoints/openai/cli_args.py__call__#s4  zLoRAParserAction.__call__N) __name__ __module__ __qualname__argparseArgumentParser Namespacerrrrr-rrrr,r!src@seZdZUdZdZeeed< dZe ed< dZ eeed< dZ e ded < d Z eed < d Zeed < ed ddZeeed< edddZeeed< edddZeeed< dZeeeed< dZeeeed< dZeeed< dZeed< dZeed< dZeeed< dZeeed< dZeeed< d Zeed< e e j!Z"e ed < dZ#eeed!< ed"ddZ$eeed#< d Z%eed$< d Z&eed%< d Z'eed&< d Z(eed'< d Z)eed(< dZ*eeed)< d*Z+eed+< dZ,eeed,< e-j.Z/eeed-< dZ0ee ed.< d Z1eed/< d Z2eed0< d Z3eed1< d Z4eed2< d Z5eed3< d Z6eed4< e7Z8e ed5< e9Z:e ed6< e;d7eVzFrontendArgs.)default_factoryallowed_originscCrArBrrrrr,rDXrEallowed_methodscCrArBrrrrr,rDZrEallowed_headersapi_key lora_modules chat_templateautochat_template_content_formatZ assistant response_role ssl_keyfile ssl_certfile ssl_ca_certsenable_ssl_refresh ssl_cert_reqs root_pathcCsgSr.rrrrr,rD{s middlewarereturn_tokens_as_token_ids disable_frontend_multiprocessingenable_request_id_headersenable_auto_tool_choice#exclude_tools_when_tool_choice_nonetool_call_parserrtool_parser_plugin tool_serverlog_config_file max_log_lendisable_fastapi_docsenable_prompt_tokens_detailsenable_server_load_trackingenable_force_include_usageenable_tokenizer_info_endpointenable_log_outputsh11_max_incomplete_event_sizeh11_max_header_countrreturncCs$ddlm}|t}tj|dd<tj|dd<tj|dd<|dd=|dd=|dd=tt|dd<t|dd <d |d d <t|d d<d|d vrS|d d=g|d d <tt j }d |}d|d|dd<|j dtjd}|D]\}}|jd|ddfi|q{|S)Nr) get_kwargsrGtyperHrInargsrKactionr rVdefaultr{z,} or name registered in --tool-parser-pluginr\metavarZFrontend)title descriptionz--_-)vllm.engine.arg_utilsrjr5r!r"r rrlistrZ tool_parserskeysjoinadd_argument_group__doc__items add_argumentreplace)rrjZfrontend_kwargsZvalid_tool_parsersZ parsers_strZfrontend_groupkeyvaluerrr, add_cli_argss4             "zFrontendArgs.add_cli_args)>r/r0r1rzr6rr__annotations__r7intr8r>rr?boolr@rrGrvrHrIrJrKrrLrNr rOrPrQrRrSssl CERT_NONErTrUrVrWrXrYrZr[r\r]r^envsZVLLM_LOGGING_CONFIG_PATHr_r`rarbrcrdrerfrrgr rh staticmethodrrrrrr,r5Es                     r5rricCs^|jdtddd|jddddd |jd d td d d|jdddt|}t|}|S)a(Create the CLI argument parser used by the OpenAI API server. We rely on the helper methods of `FrontendArgs` and `AsyncEngineArgs` to register all arguments instead of manually enumerating them here. This avoids code duplication and keeps the argument definitions in one place. Z model_tag?z8The model tag to serve (optional if specified in config))rkrlhelpz --headless store_trueFzRRun in headless mode. See multi-node data parallel documentation for more details.)rmrnrz--api-server-countz-ascz%How many API server processes to run.)rkrnrz--configzRead CLI options from a config file. Must be a YAML with the following options: https://docs.vllm.ai/en/latest/configuration/serve_args.html)r)r|rrr5rr )rrrr,make_arg_parsers0  rargscCs>t|dr |jdkr dSt|j|jr|jstddSdS)z>Quick checks for model serve args that raise prior to loading. subparserZserveNzs4         $"