o )i@sUddlZddlZddlmZmZmZddlmZeeZ da da e e d<defddZdefd d Zd aee d <d dZdefddZdS)N)CompilationConfigCompilationLevel VllmConfig) init_loggergtorch_compile_start_time vllm_configcCs`ta|j}|jtjkr,|jr.ddl}tj |jd|j j }| |atdSdSdS)NrZrank_)timercompilation_configlevelr PIECEWISEZdebug_dump_pathdepyfospathjoinZparallel_configZrankZ prepare_debugcontext_manager __enter__)rr r rrd/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/vllm/compilation/monitor.pystart_monitoring_torch_compiles     rcCsF|j}|jtjkrtd|jtdur!tddddadSdSdS)Nz#torch.compile takes %.2f s in total) r r rr loggerinfoZcompilation_timer__exit__)rr rrrend_monitoring_torch_compiles rTcudagraph_capturing_enabledcCststddS)Nz]CUDA graph capturing detected at an inappropriate time. This operation is currently disabled.)r RuntimeErrorrrrr$validate_cudagraph_capturing_enabled-srenabledcCs|adS)N)r)rrrrset_cudagraph_capturing_enabled7sr)r rZ vllm.configrrrZ vllm.loggerr__name__rrrfloat__annotations__rrrboolrrrrrrs