o W+ i2@sddlZddlmZmZmZmZmZddlmZddl m Z ddl m Z ddl mZmZddlmZmZmZmZddlmZdd lmZdd lmZdd lmZmZdd lmZm Z dd l!m"Z"ddl#m$Z$ddl%m&Z&edZ'eZ(  d2ddZ)  d2dede*de+fddZ,dddddddedf de*dee*ee*e ee fde*de*de*de*dee*d ee*d!e$fd"d#Z-  $d3de*d%e*d&e*d'e.fd(d)Z/d*d+Z0dee*ee*e ee fd,ee*d-ee*efd!ee*fd.d/Z1d-ede*fd0d1Z2dS)4N)AnyDictListOptionalUnion)snapshot_downloadDEFAULT_MODEL_FOR_PIPELINE)Model) ConfigDict check_config)DEFAULT_MODEL_REVISIONInvokeTasks ThirdParty) read_config)is_transformers_available) get_logger)register_modelhub_reporegister_plugins_repo)Registrybuild_from_cfg)is_embedding_task)Pipeline)is_official_hub_pathZ pipelinescCst|tr)t||r)tj|s'tjtji}|dur||t j<t ||||d}|St|t rgt|dtrgt t |D]+}t|||rftj||sftjtji}|dur[||t j<t ||||d||<q;|S)z normalize the input model, to ensure that a model str is a valid local path: in other words, for model represented by a model id, the model shall be downloaded locally N)revision user_agentignore_file_patternr)rr) isinstancestrrospathexistsrKEYZPIPELINErrlistrangelen)modelmodel_revision third_partyrridxr,h/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/modelscope/pipelines/builder.pynormalize_model_inputs8       r.cfg task_name default_argscCst|t||dS)a# build pipeline given model config dict. Args: cfg (:obj:`ConfigDict`): config dict for model object. task_name (str, optional): task name, refer to :obj:`Tasks` for more details. default_args (dict, optional): Default initialization arguments. )Z group_keyr1)r PIPELINES)r/r0r1r,r,r-build_pipeline:s r3taskr( config_file pipeline_name frameworkdevicer)rreturnc  Ksj|dur |dur tdd} |dur/t|ts$t|trt|dtrt||drt|tr5t||dnt|d|d} | rI| didd}|dury| d} |durf|t j t j fvrf| durfd} | ry| d dursd | d <t ||| }|dus|d kr| t j} | dur| t jt||| |d }t| d t|| dd|rd|i} nz t| | j} Wnyty}z tt|WYd}~ned}~wwn_|durt|tr|dn|}t|dst|j} z t| | j|_Wnty}z tt|WYd}~nd}~ww|jdr|j} nt|\}}t||}d|i} nd|i} | sZt|rZzddlm}|dd|i| WStyYt dw| st!rzddlm"}|d||||d| WSty}zt#d|d}~ww|sd}|| d<|| d<t$| } t%| || r| &| |dur|| _'t(| |dS)a Factory method to build an obj:`Pipeline`. Args: task (str): Task name defining which pipeline will be returned. model (str or List[str] or obj:`Model` or obj:list[`Model`]): (list of) model name or model object. preprocessor: preprocessor object. config_file (str, optional): path to config file. pipeline_name (str, optional): pipeline class name or alias name. framework (str, optional): framework type. model_revision: revision of model(s) if getting from model hub, for multiple models, expecting all models to have the same revision device (str, optional): whether to use gpu or cpu is used to do inference. ignore_file_pattern(`str` or `List`, *optional*, default to `None`): Any file pattern to be ignored in downloading, like exact file names or file extensions. Return: pipeline (obj:`Pipeline`): pipeline object for certain task. Examples: >>> # Using default model for a task >>> p = pipeline('image-classification') >>> # Using pipeline with a model name >>> p = pipeline('text-classification', model='damo/distilbert-base-uncased') >>> # Using pipeline with a model object >>> resnet = Model.from_pretrained('Resnet') >>> p = pipeline('image-classification', model=resnet) >>> # Using pipeline with a list of model names >>> p = pipeline('audio-kws', model=['damo/audio-tts', 'damo/auto-tts2']) Nz!task or pipeline_name is requiredr)rpipelinetypeexternal_engine_for_llmT llm_frameworkswiftllm)r*rpluginsZ allow_remoteF)sentence_transformers_pipeliner(zWe could not find a suitable pipeline from modelscope, so we tried to load it using the sentence_transformers, but that also failed.) hf_pipeline)r4r(r7r8z{We couldn't find a suitable pipeline from ms, so we tried to load it using the transformers pipeline, but that also failed.Zgpur8)r0r,)) ValueErrorrr r%rrZsafe_getgetlowerrZtext_generationZchatexternal_engine_for_llm_checkerrr$popr.rrr r:AssertionErrorloggerinfohasattr model_dir__dict__get_default_pipeline_inforZmodelscope.utils.hf_utilrA Exception exceptionrrBerrorr clear_llm_infoupdate preprocessorr3)r4r(rTr5r6r7r8r)rkwargsZpipeline_propsr/Zprefer_llm_pipeliner*eZ first_modelZdefault_model_reporArBr,r,r-r:Is(           2            r:F model_name modelhub_name overwritecCs,|s|tvsJd|d||ft|<dS)z Add default model for a task. Args: task (str): task name. model_name (str): model_name. modelhub_name (str): name for default modelhub. overwrite (bool): overwrite default info. ztask z already has default model.Nr)r4rWrXrYr,r,r-add_default_pipeline_infos   rZcCs>|tvrttj|d}d}||fSt|\}}||fS)z Get default info for certain task. Args: task (str): task name. Return: A tuple: first element is pipeline name(model_name), second element is modelhub name. rN)r r%r2moduleskeys)r4r6Z default_modelr,r,r-rNs   rNrrUc Csddlm}m}ddlm}t|tr|d}t|ts|j}| dd}|dkrndd l m }t j |r:||}n|}z ||} | dj} Wn"tyi} ztd |d |d | d} WYd} ~ nd} ~ ww| rnd S|j ||dddd} || rd SdS)Nr)ModelTypeHelperLLMAdapterRegistry)get_model_id_from_cacherr=r>)get_model_info_metaz Cannot using llm_framework with z, ignoring llm_framework=z : r?T-)Z with_adaptersplitZ use_cache)Znlp.llm_pipeliner]r^Zhub.check_modelr`rr%r rLrDZ swift.llmrbr!r"r# model_typerOrIwarningcontains) r(rrUr]r^r`r=rbZmodel_idrJrerVr,r,r-rFs@          rFcCs8ddlm}|dd|dkr|dd|dS)Nr)r]r<r?r=)Z"modelscope.utils.model_type_helperr]rG clear_cache)rUr6r]r,r,r-rR3s    rR)NN)NF)3r!typingrrrrrZ modelscope.hub.snapshot_downloadrZmodelscope.metainfor Zmodelscope.models.baser Zmodelscope.utils.configr r Zmodelscope.utils.constantr rrrZmodelscope.utils.hubrZmodelscope.utils.import_utilsrZmodelscope.utils.loggerrZmodelscope.utils.pluginsrrZmodelscope.utils.registryrrZmodelscope.utils.task_utilsrbaserutilrr2rIr.r dictr3r:boolrZrNrFrRr,r,r,r-s          !  "   $