o h @sdZddlZddlZddlZddlZddlZddlmZddlm Z m Z ddlm Z ddl m Z ddlmZddlmZdd lmZmZmZddlmZejZejZejZejZejZed Zd Zd d eedid dd eedid d gdddidddZe de dededdfddZ e de dededdfddZ!e de dededdfddZ"Gd d!d!e Z#e e!e"d"Z$d.d#d$Z%d%ede#fd&d'Z&e%e&e'Z(d/d(d)Z) d/d*ed+eefd,d-Z*dS)0zLogging configuration for vLLM.N)Hashable) lru_cachepartial)Logger) dictConfig)path) MethodType)AnyOptionalcastz?%(levelname)s %(asctime)s [%(fileinfo)s:%(lineno)d] %(message)sz%m-%d %H:%M:%SZvllm#vllm.logging_utils.NewLineFormatter)classdatefmtformatzlogging.StreamHandler)r formatterlevelstreamDEBUGF)handlersr propagate) formattersrloggersversiondisable_existing_loggersloggermsgargsreturncG|j|g|RddidSN stacklevel)debugrrrr%6/usr/local/lib/python3.10/site-packages/vllm/logger.py_print_debug_once9r'cGrr )infor$r%r%r&_print_info_once?r(r*cGrr )warningr$r%r%r&_print_warning_onceEr(r,c@sReZdZdZdededdfddZdededdfdd Zdededdfd d ZdS) _VllmLoggera  Note: This class is just to provide type information. We actually patch the methods directly on the [`logging.Logger`][] instance to avoid conflicting with other libraries such as `intel_extension_for_pytorch.utils._logger`. rrrNcGt||g|RdS)z~ As [`debug`][logging.Logger.debug], but subsequent calls with the same message are silently dropped. N)r'selfrrr%r%r& debug_onceTz_VllmLogger.debug_oncecGr.)z| As [`info`][logging.Logger.info], but subsequent calls with the same message are silently dropped. N)r*r/r%r%r& info_once[r2z_VllmLogger.info_oncecGr.)z As [`warning`][logging.Logger.warning], but subsequent calls with the same message are silently dropped. N)r,r/r%r%r& warning_oncebr2z_VllmLogger.warning_once) __name__ __module__ __qualname____doc__strrr1r3r4r%r%r%r&r-Ks r-)r1r3r4cCstttf}tstrtdtrt}trKttstdtt tdd}t | }Wdn1s7wYt |tsItdt|j|}|diD] }|ddkr`d |d<qS|rit|dSdS) NzVLLM_CONFIGURE_LOGGING evaluated to false, but VLLM_LOGGING_CONFIG_PATH was given. VLLM_LOGGING_CONFIG_PATH implies VLLM_CONFIGURE_LOGGING. Please enable VLLM_CONFIGURE_LOGGING or unset VLLM_LOGGING_CONFIG_PATH.z6Could not load logging config. File does not exist: %szutf-8)encodingz.Invalid logging config. Expected dict, got %s.rr zvllm.logging.NewLineFormatterr )dictr9r VLLM_CONFIGURE_LOGGINGVLLM_LOGGING_CONFIG_PATH RuntimeErrorDEFAULT_LOGGING_CONFIGrexistsopenjsonloadsread isinstance ValueErrortyper5getvaluesr)Zlogging_configfileZ custom_configrr%r%r&_configure_vllm_root_loggerrs8   rKnamecCs8t|}tD] \}}t||t||q tt|S)zThe main purpose of this function is to ensure that loggers are retrieved in such a way that we can be sure the root vllm logger has already been configured.)logging getLogger_METHODS_TO_PATCHitemssetattrrr r-)rLr method_namemethodr%r%r& init_loggers  rTcCs.|dvr|jj}|j}|jj}||sdSzq|j}|dur*|jj} |j} |jj} nd} d} d} t|dI} tj d} |dkr]| | d|d|d |d | d| d | d n| | d |d|d |d | d| d | d Wdn1swYWn t yYnwt t ||S)N)callrraz%Y-%m-%d %H:%M:%S.%frUz Call to z in :z from  z Return from z to )f_code co_filenamef_linenoco_name startswithf_backrAdatetimenowstrftimewrite NameErrorr _trace_calls)log_pathroot_dirframeeventargfilenamelineno func_nameZ last_frameZ last_filenameZ last_linenoZlast_func_nameftsr%r%r&resf        re log_file_pathrgcCsHtdtd||durtjtjt}tt t ||dS)a Enable tracing of every function call in code under `root_dir`. This is useful for debugging hangs or crashes. `log_file_path` is the path to the log file. `root_dir` is the root directory of the code to trace. If None, it is the vllm root directory. Note that this call is thread-level, any threads calling this function will have the trace enabled. Other threads will not be affected. zVLLM_TRACE_FUNCTION is enabled. It will record every function executed by Python. This will slow down the code. It is suggested to be used for debugging hang or crashes only.zTrace frame log is saved to %sN) rr+r)osrdirname__file__syssettracerre)rprgr%r%r&enable_trace_function_calls  rv)rN)N)+r8r`rBrMrqrtcollections.abcr functoolsrrrlogging.configrrtypesrtypingr r r Z vllm.envsZenvsr<r=ZVLLM_LOGGING_LEVELZVLLM_LOGGING_PREFIXZVLLM_LOGGING_STREAMZ_FORMATZ _DATE_FORMATr?r9r'r*r,r-rOrKrTr5rrervr%r%r%r&s~        ! # (