o )i@sddlmZddlZddlmZddlmZddlmZddl m Z m Z m Z m Z mZddlmZddlmZmZe rKdd lmZmZmZdd lmZne Ze Ze Ze ZeeZGd d d ZGd ddZdS)) annotationsN)abstractmethod)Sequence)cached_property) TYPE_CHECKINGAnyCallableOptionalUnion) init_logger)import_from_path is_list_of)ChatCompletionRequest DeltaMessageResponsesRequest) AnyTokenizerc@s`eZdZdZd#ddZed$dd Zed%d dZed&ddZ ed'ddZ ed(d d!Z d"S))ReasoningParserz Abstract reasoning parser class that should not be used directly. Provided and methods should be used in derived classes. It is used to extract reasoning content from the model output. tokenizerrcCs ||_dSN)model_tokenizer)selfrrp/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/vllm/reasoning/abs_reasoning_parsers.py__init__%s zReasoningParser.__init__returndict[str, int]cCs |jSr)rZ get_vocab)rrrrvocab(s zReasoningParser.vocab input_ids list[int]boolcCdS)a Check if the reasoning content ends in the input_ids. It is used in structured engines like `xgrammar` to check if the reasoning content ends in the model output. Parameters: input_ids: list[int] The input_ids of the model output. Returns: bool True if the reasoning content ends in the input_ids. Nrrrrrris_reasoning_end.z ReasoningParser.is_reasoning_endcCr )z Extract content token ids from the input_ids. Parameters: input_ids: list[int] The input_ids of the model output. Returns: list[int] The extracted content from the input_ids. Nrr!rrrextract_content_ids?r#z#ReasoningParser.extract_content_ids model_outputstrrequest.Union[ChatCompletionRequest, ResponsesRequest]#tuple[Optional[str], Optional[str]]cCr )aE Extract reasoning content from a complete model-generated string. Used for non-streaming responses where we have the entire model response available before sending to the client. Parameters: model_output: str The model-generated string to extract reasoning content from. request: ChatCompletionRequest The request object that was used to generate the model_output. Returns: tuple[Optional[str], Optional[str]] A tuple containing the reasoning content and the content. Nr)rr%r'rrrextract_reasoning_contentKr#z)ReasoningParser.extract_reasoning_content previous_text current_text delta_textprevious_token_ids Sequence[int]current_token_idsdelta_token_idsUnion[DeltaMessage, None]cCr )az Instance method that should be implemented for extracting reasoning from an incomplete response; for use when handling reasoning calls and streaming. Has to be an instance method because it requires state - the current tokens/diffs, but also the information about what has previously been parsed and extracted (see constructor) Nr)rr+r,r-r.r0r1rrr#extract_reasoning_content_streamingcr#z3ReasoningParser.extract_reasoning_content_streamingN)rr)rr)rrrr)rrrr)r%r&r'r(rr))r+r&r,r&r-r&r.r/r0r/r1r/rr2) __name__ __module__ __qualname____doc__rrrrr"r$r*r3rrrrrs     rc@s`eZdZUiZded<edddZe ddddZe dd ddZed!ddZ d S)"ReasoningParserManagerzdict[str, type]reasoning_parsersname str | Nonertype[ReasoningParser]cCs$||jvr |j|Std|d)z Get reasoning parser by name which is registered by `register_module`. Raise a KeyError exception if the name is not registered. zreasoning helper: 'z ' not found in reasoning_parsers)r9KeyError)clsr:rrrget_reasoning_parserys   z+ReasoningParserManager.get_reasoning_parserNTmoduletype module_nameOptional[Union[str, list[str]]]forcerNonecCs~t|tstdt||dur|j}t|tr|g}|D]}|s7||jvr7|j|}t|d|j ||j|<qdS)Nz4module must be subclass of ReasoningParser, but got z is already registered at ) issubclassr TypeErrorrAr4 isinstancer&r9r=r5)r>r@rBrDr:Zexisted_modulerrr_register_modules    z'ReasoningParserManager._register_moduleUnion[type, None]Union[type, Callable]cszttstdtdus%tts%tts%tdt|dur3j|d|Sfdd}|S)z Register module with the given name or name list. it can be used as a decoder(with module as None) or normal function(with module as not None). z!force must be a boolean, but got NzEname must be None, an instance of str, or a sequence of str, but got r@rBrDcsj|d|S)NrL)rI)r@r>rDr:rr _registersz9ReasoningParserManager.register_module.._register)rHrrGrAr&r rI)r>r:rDr@rNrrMrregister_modules z&ReasoningParserManager.register_module plugin_pathr&cCsLtjtj|d}zt||WdSty%td||YdSw)zq Import a user-defined reasoning parser by the path of the reasoning parser define file. rz#Failed to load module '%s' from %s.N)ospathsplitextbasenamer Exceptionlogger exception)r>rPrBrrrimport_reasoning_parsers z.ReasoningParserManager.import_reasoning_parser)r:r;rr<)NT)r@rArBrCrDrrrE)NTN)r:rCrDrr@rJrrK)rPr&rrE) r4r5r6r9__annotations__ classmethodr?rIrOrXrrrrr8vs   !r8) __future__rrQabcrcollections.abcr functoolsrtypingrrrr r Z vllm.loggerr Z vllm.utilsr r Z vllm.entrypoints.openai.protocolrrrZ!vllm.transformers_utils.tokenizerrr4rVrr8rrrrs$     Y