o yq ih@sddlZddlmZmZddlmZddlmZddlm Z m Z m Z ddl Tddl mZd d lmZd ed d fddZGdd d eedZdS)N)ABCabstractmethod)Path)AttrDict)check_supported_deviceset_env_for_deviceupdate_device_num)*)AutoRegisterABCMetaClass) build_modelconfigreturn BaseEvaluatorcCs.|jj}zWn tyYnwt||S)zbuild model evaluator Args: config (AttrDict): PaddleX pipeline config, which is loaded from pipeline yaml file. Returns: BaseEvaluator: the evaluator, which is subclass of BaseEvaluator. )GlobalmodelModuleNotFoundErrorrget)rZ model_namere/home/app/PaddleOCR-VL/.venv_paddleocr/lib/python3.10/site-packages/paddlex/modules/base/evaluator.pybuild_evaluators  rcseZdZdZdZfddZddZdedefd d Z defd d Z dddZ dde de fddZeddZeddZZS)rzBase Model EvaluatorTcs`t|j|_|j|_||jj}|jddr"|jdd}t |jj |d\|_ |_ dS)zInitialize the instance. Args: config (AttrDict): PaddleX pipeline config, which is loaded from pipeline yaml file. Zbasic_config_pathN) config_path) super__init__r global_configZEvaluateZ eval_configget_config_path weight_pathrr r pdx_config pdx_model)selfrr __class__rrr4s zBaseEvaluator.__init__cCsHt|jd}|s|jjd}|s"td|d|dd}|S)z get config path Args: weight_path (str): The path to the weight Returns: config_path (str): The path to the config config.yamlzThe config file (`z`) related to weight file (`z)`) does not exist. Using default instead.N)rparentexistswarning)r rrrrrrFs  zBaseEvaluator.get_config_pathmetricsrcCs8t|tsdS|D]}||}t|ttfsdSq dS)zcheck evaluation metrics Args: metrics (dict): evaluation output metrics Returns: bool: whether the format of evaluation metrics is legal FT) isinstancedictfloatint)r r'Zmetricvalrrr check_return]s zBaseEvaluator.check_returncCsb||jjdi|}|jdksJd|jd|j}||s-Jd|dd|iS) z\execute model evaluating Returns: dict: the evaluation metrics rz Encountered an unexpected error(z ) in evaling!zThe return value(z!) of Evaluator.eval() is illegal!r'Nr) update_configrevaluateget_eval_kwargs returncoder'r-)r Zevaluate_resultr'rrrr/ns   zBaseEvaluator.evaluateNcCs*|dur tj|jjd}|j|dS)zdump the config Args: config_file_path (str, optional): the path to save dumped config. Defaults to None, means that save in `Global.output` as `config.yaml`. Nr#)ospathjoinroutputrdump)r Zconfig_file_pathrrr dump_configszBaseEvaluator.dump_configusing_device_numbercCsHt|jj|jjt|jj|rt|jj|n|jj}|dd}|S)a#get device setting from config Args: using_device_number (int, optional): specify device number to use. Defaults to None, means that base on config setting. Returns: str: device setting, such as: `gpu:0,1`, `npu:0,1`, `cpu`. ZdcuZgpu)rrZdevicerrr replace)r r8Zdevice_settingrrr get_devices  zBaseEvaluator.get_devicecCt)zupdate evaluation configNotImplementedErrorr rrrr.zBaseEvaluator.update_configcCr;)z4get key-value arguments of model evaluation functionr<r>rrrr0r?zBaseEvaluator.get_eval_kwargs)N)__name__ __module__ __qualname____doc__Z_BaseEvaluator__is_baserrr)boolr-r/r7r+strr:rr.r0 __classcell__rrr!rr/s    ) metaclass)r2abcrrpathlibrZ utils.configrZ utils.devicerrr Z utils.loggingZ utils.miscr r rrrrrrs