o * i@sddlmZddlZddlZddlmZmZmZddlZ ddl Z ddl m Z ddl mZmZmZmZmZmZddlmZerXddlmZddlmZddl mZGd d d eZeeejd d ZeZeZ ej!Z"eZ#eZeZ$d*ddZ%d+ddZ&ddZ'de(fd,d(d)Z)e%e_*e&e_+e'e_,dS)-) annotationsN) TYPE_CHECKINGAny TypedDict)core)AnalysisConfig PaddleDTypePaddleInferPredictorPaddleInferTensor PaddlePlaceconvert_to_mixed_precision_bind) get_logger)Unpack)Tensorc@seZdZUded<dS) _WhiteListset[str] white_listN)__name__ __module__ __qualname____annotations__rrd/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/paddle/inference/wrapper.pyr)s rz&%(asctime)s-%(levelname)s: %(message)s)fmtdatanpt.NDArray[Any] | list[str]returnNonecCsFt|tjst|trt|dkrt|dtr||dStd)zA Support input type check based on tensor.copy_from_cpu. rzHIn copy_from_cpu, we only support numpy ndarray and list[str] data type.N) isinstancenpZndarraylistlenstrZ_copy_from_cpu_bind TypeErrorselfrrrrtensor_copy_from_cpu9s r&rcCsTt|tjr ||dSt|tjr||dSt|tjjj r&t dt d)zG Support input type check based on tensor.share_external_data. zThe interface 'share_external_data' can only be used in dynamic graph mode. Maybe you called 'paddle.enable_static()' and you are in static graph mode now. Please use 'copy_from_cpu' instead.z?In share_external_data, we only support Tensor and DenseTensor.N) rrZ DenseTensorZ_share_external_data_bindpaddlerZ'_share_external_data_paddle_tensor_bindbaseZ frameworkVariabler#r$rrrtensor_share_external_dataGs  r*cCs|||||dS)z9 Support tensor.share_external_data_by_ptr_name. N)Z%_share_external_data_by_ptr_name_bind)r%rshapeZdtypeZplacerrr&tensor_share_external_data_by_ptr_name[sr,T model_filer" params_filemixed_model_filemixed_params_filemixed_precision PrecisionTypebackend PlaceType keep_io_typesbool black_listrkwargsUnpack[_WhiteList]c Ks|tjurtstdtj|} t |dkr tj|n| } tj | s-t | | dt } t||||||||| dS)a Convert a fp32 model to mixed precision model. Args: model_file: fp32 model file, e.g. inference.pdmodel. params_file: fp32 params file, e.g. inference.pdiparams. mixed_model_file: The storage path of the converted mixed-precision model. mixed_params_file: The storage path of the converted mixed-precision params. mixed_precision: The precision, e.g. PrecisionType.Half. backend: The backend, e.g. PlaceType.GPU. keep_io_types: Whether the model input and output dtype remains unchanged. Default is True. black_list: Operators that do not convert precision. kwargs: Supported keys including 'white_list'. - white_list: Operators that do convert precision. zOYou should use PaddlePaddle compiled with GPU when backend set to PlaceType.GPUrrN)r4ZGPUrZis_compiled_with_cuda_loggererrorospathdirnamer!existsmakedirsgetsetr ) r-r.r/r0r1r3r5r7r8Zmixed_model_dirnameZmixed_params_dirnamerrrrconvert_to_mixed_precisionbs.     rC)rrrr)rrrr)r-r"r.r"r/r"r0r"r1r2r3r4r5r6r7rr8r9rr)- __future__rloggingr<typingrrrnumpyrr'Z paddle.baserZpaddle.base.corerrr r r r Zpaddle.base.log_helperr Z numpy.typingZnptZtyping_extensionsrrrrINFOr:ZDataTyper4Z Precisionr2ZConfigZ Predictorr&r*r,rBrCZ copy_from_cpuZshare_external_dataZshare_external_data_by_ptr_namerrrrs@          9