o yq i:Z@s$ddlZddlZddlZddlZddlZddlZddlZddlm Z ddl m Z ddl m Z ddlmZddlmZddlmZmZdd lmZdd lmZmZmZmZmZmZmZdd lm Z m!Z!m"Z"dd l#m$Z$m%Z%dd l&m'Z'ddl(m)Z)ddZ*ddZ+ddZ,ddZ-ddZ.ddZ/dS)N)Path)create_pipeline)MODEL_FILE_PREFIX)load_pipeline_config)get_model_paths)get_all_supported_repo_namessetup)logging)get_dep_versionget_genai_dep_specsget_genai_fastdeploy_specget_paddle2onnx_dep_specsget_serving_dep_specsis_dep_availableis_paddle2onnx_plugin_available)get_gpu_compute_capabilityget_paddle_cuda_versionis_cuda_available)install_packagesuninstall_packages)interactive_get_pipeline)PIPELINE_ARGUMENTSc Csdd}td}|d}|d}|d}|d}|jdd d d d |jd ddd|jdtddgddd|jdddddd|jddddd|jdtd d!d"d#|jd$td%d&|jd'td!d(d)|jd*td!d+d)|jd,td!d-d)|jd.dd/d|jd0tjd1d&|jd2td!d3d)|jd4dd5d|jd6td7d8d)|jd9td:d;d)|jdtd?d&|jd@tdAd&|jdBtdCdDd)|\}}|j }g} |j d!usQ|j sQ|j sQ|d!urQt j|rt|dE} n|} | tvrdFt} tdG| dH| dItdJt| } | d!ur$g} || dK} | D] } | j| dL| dMtur@|n| dM| dNdO| dPd&q0|| fS)Qzparse cli argumentscSs(|dvrdS|dvr dS|dvrdS|S)zuconvert str type value to None type if it is "None", to bool type if it means True or False. )NonenoneNONEN)TRUETruetrueTtT)FALSEFalsefalseFfF)sr&r&Z/home/app/PaddleOCR-VL/.venv_paddleocr/lib/python3.10/site-packages/paddlex/paddlex_cli.py parse_str4szargs_cfg..parse_strzCommand-line interface for PaddleX. Use the options below to install plugins, run pipeline predictions, or start the serving application.zInstall PaddleX OptionszPipeline Predict OptionszServing OptionszPaddle2ONNX Optionsz --install*ZPLUGINz"Install specified PaddleX plugins.)nargsmetavarhelpz --no_deps store_truez>Install custom development plugins without their dependencies.)actionr-z --platformz github.comz gitee.comz7Platform to use for installation (default: github.com).)typechoicesdefaultr-z-yz--yes update_reposz6Automatically confirm prompts and update repositories.)destr/r-z--use_local_reposFz%Use local repositories if they exist.)r/r2r-z--deps_to_replace+Nz=Replace dependency version when installing from repositories.)r0r+r2r-z --pipelinez/Name of the pipeline to execute for prediction.)r0r-z--inputzJInput data or path for the pipeline, supports specific file and directory.)r0r2r-z --save_pathz$Path to save the prediction results.z--devicez5Device to run the pipeline on (e.g., 'cpu', 'gpu:0').z --use_hpipz&Use high-performance inference plugin.z --hpi_configz)High-performance inference configuration.z--get_pipeline_configz4Retrieve the configuration for a specified pipeline.z--servez1Start the serving application to handle requests.z--hostz0.0.0.0z,Host address to serve on (default: 0.0.0.0).z--portiz(Port number to serve on (default: 8080).z --paddle2onnxz*Convert PaddlePaddle model to ONNX format.z--paddle_model_dirz,Directory containing the PaddlePaddle model.z--onnx_model_dirz$Output directory for the ONNX model.--opset_versionz!Version of the ONNX opset to use. pipeline_namez, zUnsupported pipeline: z-, CLI predict only supports these pipelines:  rz Pipeline Optionsnamer0r-z Argument for z pipeline.)argparseArgumentParseradd_argument_group add_argumentstrast literal_evalintparse_known_argspipelineinstallserve paddle2onnxospathisfilerrjoinkeysr errorsysexit capitalizeboolget)r)parserZ install_groupZpipeline_groupZ serving_groupZpaddle2onnx_groupargsremaining_argsrD pipeline_argsr8Zsupport_pipelinesZpipeline_specific_groupargr&r&r(args_cfg1s"               rXcCsdd}dd}dd}dd}d tjd <d tjd <|jd d }d|vr;|d|r6tdtd|d Sd|vrU|d|rPtdtd|d Stt dd|}|r|D]}||qb|rvtdtdt |dkst |d ddkrtdtd|d dd}||dd Stt dd|} | r| D]}||q|rtdtddd| D} || d St } g} |D] }|| vr| |q| rtd| td|r|} nt |dkr| } t| |j|j|j|j|jd d S)!zinstall paddlexcSHzttWntytjdddtdYnwtddS)NInstallation failedTexc_inforz)Successfully installed the serving plugin)rr Exceptionr rMrNrOinfor&r&r&r(_install_serving_deps z&install.._install_serving_depscSrY)NrZTr[rz-Successfully installed the Paddle2ONNX plugin)rrr]r rMrNrOr^r&r&r&r(_install_paddle2onnx_depsr`z*install.._install_paddle2onnx_depsc Ss gd}||vrtd||tdd}|dkr8t}|s$td|ddkr-d }n |dd kr8td d d dd}||}t||h}|D]9}t|}|durtd|d|d|d|d zt |gWqMt ytjdddtdYqMwqMt j d|^} t|}z<|durt|gdt| gdn*tdt|d} | dvrt |gt|gdt| gdn WWddSWnt ytjdddtdYnwWdn1swYtdtstd dSdS)!N)cpugpuZnpuzgFailed to install the high-performance plugin. Supported device types: %s. Your input device type: %s. zhpip_links.htmlrczZNo CUDA version found. Please make sure you have installed PaddlePaddle with CUDA enabled.r zhpip_links_cu12.html zcCurrently, only CUDA versions 11.x and 12.x are supported by the high-performance inference plugin.zultra-infer-pythonzultra-infer-gpu-pythonzultra-infer-npu-pythonz'The high-performance inference plugin 'z' is mutually exclusive with 'z ' (version z installed). Uninstalling 'z'...zFailed to uninstall packagesTr[rZpaddlexz --find-linksZpip_install_optszDThe high-performance inference plugin is already installed (version z&). Do you want to reinstall it? (y/n):)yyesrZz._install_hpi_depsc Ss"g}g}|D]}d|vr||q||q|rgtds#tdt}|dvr-d}n|dvr4d}ntd|d d |d d z ttd gd|gdWntyftj dddtd Ynwg}|D]!}zt |}Wnt yt d|tdYnw||7}qkzt|ddWntytj dddtd Ynw|D]Q}d|vsd|vrtdgddt rz%tdgddt}|dusJ|dkrtdgddntdgddWntytj dddtd Ynwnqt dt|d kr dnd dS)!NZ fastdeployZ paddlepaddlez"Please install PaddlePaddle first.))r) rzEhttps://www.paddlepaddle.org.cn/packages/stable/fastdeploy-gpu-80_90/))rv)rvrwzEhttps://www.paddlepaddle.org.cn/packages/stable/fastdeploy-gpu-86_89/z%The compute capability of the GPU is r.rzX, which is not supported. The supported compute capabilities are 8.0, 8.6, 8.9, and 9.0.rcz--extra-index-urlrgrZTr[z%Invalid generative AI plugin type: %srdrequired) constraintsZvllmZsglangZxformerswheel)rerzflash-attn == 2.8.3zflash-attn == 2.8.2z/Successfully installed the generative AI pluginr')appendrrNrOrrr r]r rMr ValueErrorrr^len)Z plugin_typesZfd_plugin_typesZnot_fd_plugin_typesZ plugin_typecap index_urlreqsrr&r&r(_install_genai_depsFs           z$install.._install_genai_depsrZPADDLE_PDX_DEBUGr"ZPADDLE_PDX_EAGER_INITNZservingz5`serving` cannot be used together with other plugins.rdrGz9`paddle2onnx` cannot be used together with other plugins.cS |dS)Nzhpi- startswithr:r&r&r( zinstall..z5`hpi-xxx` cannot be used together with other plugins.rr-zInvalid HPI plugin installation format detected. Correct format: paddlex --install hpi- Example: paddlex --install hpi-gpu)rqcSr)Ngenai-rrr&r&r(rrz7`genai-xxx` cannot be used together with other plugins.cSsg|] }|tddqS)rN)r).0pr&r&r( szinstall..zUnknown plugins: %s) repo_namesno_depsplatformr3use_local_reposdeps_to_replace)rHenvironrEremover rMrNrOlistfilterrsplitrr~r rrr3rr)rTr_rarurpluginsZ hpi_pluginsrrqZ genai_pluginsZgenai_plugin_typesZall_repo_namesZunknown_pluginsrr&r&r(rEsM G          "         rEc KsHt||||d}|j|fi|}|D]}||r!|j|dqdS)zpipeline predict)deviceuse_hpip hpi_config) save_pathN)rZpredictprintZsave_all) rDrnrrrrrVresultresr&r&r(pipeline_predicts  rc Csz ddlm}m}WntytjdddtdYnwt|}z t ||||d}Wnt yCtjdddtdYnw|||} || ||ddS) Nr)create_pipeline_app run_serverz!Failed to load the serving moduleTr[)configrrrzFailed to create the pipeline)hostport) Zinference.serving.basic_servingrr RuntimeErrorr rMrNrOrrr]) rDrrrrrrrZpipeline_configappr&r&r(rFs(   rFcststdtdtddgfdd}dd}fd d }fd d }fd d}|s8tdt|}|s@|}t|}td|td|||||||||rj||st||||||tddS)Nz,Please install the Paddle2ONNX plugin first.z.onnxz.ymlz scaler.pklcs|dur td|st|d|s!t|dt|}d|vr.td|}|s@t|ddSdS)Nz!Input directory must be specifiedz does not existz is not a directorypaddlez!PaddlePaddle model does not exist)rNrOexistsis_dirr) input_dir model_pathsZ config_pathCONFIG_FILENAMEr&r(_check_input_dir s  z(paddle_to_onnx.._check_input_dircSs tddurtddSdS)NrGz>Paddle2ONNX is not available. Please install the plugin first.)shutilwhichrNrOr&r&r&r(_check_paddle2onnxsz*paddle_to_onnx.._check_paddle2onnxc st|}tdddt|ddjdt|ddjdt|ddjd t|d t|g }zt|WntjyT}zt d |j WYd}~nd}~wwtd dS) Nz"Paddle2ONNX conversion starting...rGz --model_dirrrz--model_filenamez--params_filenamerz --save_filer6z-Paddle2ONNX conversion failed with exit code z Paddle2ONNX conversion succeeded) rr r^r?parentr: subprocess check_callCalledProcessErrorrNrO returncode)r output_dir opset_versionrcmde)ONNX_MODEL_FILENAMEr&r(_run_paddle2onnxs*   z(paddle_to_onnx.._run_paddle2onnxcs6|}|}t||td|d|dSNzCopied z to )rcopyr r^)rrsrc_pathdst_pathrr&r(_copy_config_file3s z)paddle_to_onnx.._copy_config_filecsJD] }||}|s q||}t||td|d|qdSr)rrrr r^)rrfilenamerr)ADDITIONAL_FILENAMESr&r(_copy_additional_files9s z.paddle_to_onnx.._copy_additional_filesz.PaddlePaddle model directory must be specifiedz Input dir: z Output dir: Done) rrNrOrrr r^rsamefile)paddle_model_dironnx_model_dirrrrrrrr&)rrrr(paddle_to_onnxs2           rcCsbt\}}|}ttjdkrtd|td|j dur)t |dS|j r@t |j |j |j p5d|j|j|jddS|jrOt|j|j|jddS|jdur]t|j|jdSi}|D]}|dd}t||rwt||||<qatd |d qazt|j |j|j |jf|j pd|jd |WdStytjd d dtdYdSw)zAPI for command linerz3No arguments provided. Displaying help information:rdN)rrrrr)rr:rz Argument z is missing in args)rrzPipeline prediction failedTr[) rX parse_argsrrNargvr warning print_helprOrErFrDrrrrrrGrrrrZget_pipeline_configrrlstriphasattrgetattrrrnr]rM)rSrVrTZpipeline_args_dictrWZarg_namer&r&r(mainUs^         r)0r;r@importlib.resourcesrlrHrrrNpathlibrr}r constantsrZinference.pipelinesrZinference.utils.model_pathsrZ repo_managerrr utilsr Z utils.depsr r r rrrrZ utils.envrrrZ utils.installrrZutils.interactive_get_pipelinerZutils.pipeline_argumentsrrXrErrFrrr&r&r&r(s6      $   6r S