o )i@s8ddlZddlmZmZddlmZGdddeZdS)N) add_cli_argsmain)BenchmarkSubcommandBasec@sHeZdZdZdZdZedejddfddZ e d ej ddfd d Z dS) BenchmarkLatencySubcommandz* The `latency` subcommand for vllm bench. Zlatencyz4Benchmark the latency of a single batch of requests.parserreturnNcCs t|dSN)r)clsrr r/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/vllm/entrypoints/cli/benchmark/latency.pyr z'BenchmarkLatencySubcommand.add_cli_argsargscCs t|dSr)r)r r r r cmdr zBenchmarkLatencySubcommand.cmd) __name__ __module__ __qualname____doc__namehelp classmethodargparseArgumentParserr staticmethod Namespacerr r r r r sr)rZvllm.benchmarks.latencyrrZ#vllm.entrypoints.cli.benchmark.baserrr r r r s