o ưi @s8dZddlZddlZddlmZmZddlmZmZm Z m Z m Z m Z ddl mZmZddlmZddlmZddlmZmZdd lmZmZmZGd d d eZGd d d eZde ede efddZ ddede edefddZ dde e e eefde ede efddZ!de ede efddZ"dS)z) Utility functions for base LLM classes. N)ABCabstractmethod)AnyDictListOptionalTypeUnion)_parsing _pydantic) BaseModel)verbose_logger)AllMessageValuesChatCompletionToolCallChunk)MessageProviderSpecificModelInfoTokenCountResponsec@seZdZe    ddedeeeeefdeeeeefdeeeefdedeeeeefd eed ee fd d Z e dd eed e fddZ dS)BaseTokenCounterN model_to_usemessagescontents deployment request_modeltoolssystemreturncsdSN)selfrrrrrrrrrW/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/base_llm/base_utils.py count_tokenss zBaseTokenCounter.count_tokenscustom_llm_providercCdS)zr Returns True if we should the this API for token counting for the selected `custom_llm_provider` Fr)rr"rrr should_use_token_counting_api z.BaseTokenCounter.should_use_token_counting_api)NrNNr) __name__ __module__ __qualname__rstrrrrrrr!boolr$rrrr rs<  rc@seZdZdedeefddZe ddeedeedeefdd Z e eddeedeefd d Z e e ddeedeefd d Z e  dde dedeede de deedeede fddZe ededeefddZdeefddZdS)BaseLLMModelInfomodelrcCr#)zE Default values all models of this provider support. Nr)rr,rrr get_provider_info,z"BaseLLMModelInfo.get_provider_infoNapi_keyapi_basecCsgS)zF Returns a list of models supported by this provider. r)rr/r0rrr get_models5r.zBaseLLMModelInfo.get_modelscCdSrr)r/rrr get_api_key>szBaseLLMModelInfo.get_api_keycCr2rr)r0rrr get_api_baseCszBaseLLMModelInfo.get_api_baseheadersroptional_paramslitellm_paramscCr2rr)rr5r,rr6r7r/r0rrr validate_environmentJs z%BaseLLMModelInfo.validate_environmentcCr#)a2 Returns the base model name from the given model name. Some providers like bedrock - can receive model=`invoke/anthropic.claude-3-opus-20240229-v1:0` or `converse/anthropic.claude-3-opus-20240229-v1:0` This function will return `anthropic.claude-3-opus-20240229-v1:0` Nrr,rrr get_base_modelWs zBaseLLMModelInfo.get_base_modelcCr#)z Factory method to create a token counter for this provider. Returns: Optional TokenCounterInterface implementation for this provider, or None if token counting is not supported. Nr)rrrr get_token_counterbr%z"BaseLLMModelInfo.get_token_counter)NNr)r&r'r(r)rrr-rrr1 staticmethodr3r4dictrr8r:rr;rrrr r++sd       r+ tool_callsrcCs|ddd}z0|dur7t|}t|tr,|d}dur,tt|d}|WStt|d}|WSWdStjyHt|dYSw)z In JSON mode, Anthropic API returns JSON schema as a tool call, we need to convert it to a message to follow the OpenAI format rfunction argumentsNvalues)content)getjsonloads isinstancer=rdumpsJSONDecodeError)r>Zjson_mode_content_strargsrA_messagerrr !_convert_tool_response_to_messagems  rKresponse_format ref_templatecsHdur"|ddkr"t|}|dd}fdd}|||S|S)Ntype json_schemaschemac s|gfg}t}|rx|\}}t|}||vrq||t|trUd|vr:|d}|dd}j|d|d<|D]\}} t| tt frS| | ||gfq>nt|t rtt |D]\} } t| tt frs| | || gfq^|s dSdS)Nz$ref/r9) setpopidaddrFr=splitformatitemslistappend enumerate) rPstackvisitedobjpathobj_idZref_pathZ model_namekviitemrMrr update_refss0      z4_dict_to_response_format_helper..update_refs)rCcopydeepcopy)rLrMZmodified_formatrPrgrrfr _dict_to_response_format_helpers   rjcCsn|durdSt|trt||Stj|std||dur(|j|d}nt |}d||j dddS)z Re-implementation of openai's 'type_to_response_format_param' function Used for converting pydantic object to api schema. Nz#Unsupported response_format type - rfrOT)rPnamestrict)rNrO) rFr=rjr Z _completionsZis_basemodel_type TypeErrorZmodel_json_schemar Zto_strict_json_schemar&)rLrMrPrrr type_to_response_format_params     rnrcCsHg}|D]}|ddkrtd|d|ddq||q|S)zO Translate `developer` role to `system` role for non-OpenAI providers. roleZ developerzCTranslating developer role to system role for non-OpenAI providers.rrB)rorB)r debugr[)rZ new_messagesmrrr !map_developer_role_to_system_roles  rrr)#__doc__rhrDabcrrtypingrrrrrr Z openai.libr r Zpydanticr Zlitellm._loggingr Zlitellm.types.llms.openairrZlitellm.types.utilsrrrrr+rKr=r)rjrnrrrrrr sL   B  + $