o ưi",@sdZddlmZddlmZmZmZmZmZm Z m Z m Z ddl Z ddl Z ddlmZddlmZddlmZmZddlmZdd lmZmZd d lmZd d lmZGdddeeZGdddeZ GdddeZ!dS)z Support for OpenAI's `/v1/chat/completions` endpoint. Calls done in OpenAI/openai.py as OpenRouter is openai-compatible. Docs: https://openrouter.ai/docs/parameters )Enum)Any AsyncIteratorIteratorListOptionalTupleUnioncastN)BaseModelResponseIterator)BaseLLMException)AllMessageValuesChatCompletionToolParam)OpenRouterErrorMessage) ModelResponseModelResponseStream)OpenAIGPTConfigOpenRouterExceptionc@s$eZdZdZdZdZdZdZdZdS)CacheControlSupportedModelsz4Models that support cache_control in content blocks.ZclaudegeminiZminimaxZglmzz-aiN) __name__ __module__ __qualname____doc__ZCLAUDEZGEMINIZMINIMAXZGLMZZAIrrb/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/openrouter/chat/transformation.pyrsrcseZdZdedeffdd Zdededededef fdd Zdedefd d Z d*ded e e de e dde e e e e dfffdd Zd e e de e fddZded e e dedededef fdd Z d+dedejdededed e e dededede ede edeffdd Zd!ed"edeeejfdefd#d$Z %d,d&eeeeeefd'ede edefd(d)ZZS)-OpenrouterConfigmodelreturncsbtj|d}ztj|ddstj|dr|d|dWn ty)Ynwtt|S)zU Allow reasoning parameters for models flagged as reasoning-capable. )r Z openrouter)r Zcustom_llm_providerZreasoning_effortZthinking) superget_supported_openai_paramslitellmZsupports_reasoningappend Exceptionlistdictfromkeys)selfr Zsupported_params __class__rrr##s    z,OpenrouterConfig.get_supported_openai_paramsnon_default_paramsoptional_params drop_paramsc svt||||}i}|dd}|dd}|dd} |dur%||d<|dur-||d<| dur5| |d<||d<|S)N transformsmodelsroute extra_body)r"map_openai_paramspop) r*r-r.r r/Zmapped_openai_paramsr3r0r1r2r+rrr42s    z"OpenrouterConfig.map_openai_paramscs|tfddtDS)z Check if the model supports cache_control in content blocks. Returns: bool: True if model supports cache_control (Claude or Gemini models) c3s|]}|jvVqdSN)value).0Zsupported_modelZ model_lowerrr Us  zFOpenrouterConfig._supports_cache_control_in_content..)loweranyr)r*r rr9r"_supports_cache_control_in_contentMs z3OpenrouterConfig._supports_cache_control_in_contentNmessagestoolsrcs"||r ||fSt|||Sr6)r=r"1remove_cache_control_flag_from_messages_and_tools)r*r r>r?r+rrr@Zs zBOpenrouterConfig.remove_cache_control_flag_from_messages_and_toolsc Csg}|D]V}t|}|dd}|durR|d}t|trIt|dkrHg}t|D]\}} t| } |t|dkr>|| d<|| q*||d<n d||dg|d<|tt |q|S)aD Move cache_control from message level to content blocks. OpenRouter requires cache_control to be inside content blocks, not at message level. To avoid exceeding Anthropic's limit of 4 cache breakpoints, cache_control is only added to the LAST content block in each message. cache_controlNcontentrtext)typerDrA) r(r5get isinstancer'len enumerater%r r ) r*r>Ztransformed_messagesmessageZ message_dictrArBZ content_copyiblockZ block_dictrrr_move_cache_control_to_contentgs.       z/OpenrouterConfig._move_cache_control_to_contentlitellm_paramsheaderscsV||r ||}|di}t|||||}||d|vr)ddi|d<|S)z Transform the overall request to be sent to the API. Returns: dict: The transformed request. Sent as the body of the API call. r3usageincludeT)r=rMr5r"transform_requestupdate)r*r r>r.rNrOr3responser+rrrRs      z"OpenrouterConfig.transform_request raw_responsemodel_response logging_obj request_dataencodingapi_key json_modec  stj||||||||| | | d }z>|} d| vrG| drJ| dd} | durMt|ds1i|_d|jvr;i|jd<t| |jdd<W|SW|SW|SW|StyYY|Sw)z Transform the response from OpenRouter API. Extracts cost information from response headers if available. Returns: ModelResponse: The transformed response with cost information. ) r rUrVrWrXr>r.rNrYrZr[rPZcostN_hidden_paramsZadditional_headersz$llm_provider-x-litellm-response-cost)r"transform_responsejsonrFhasattrr\floatr&)r*r rUrVrWrXr>r.rNrYrZr[Z response_jsonZ response_costr+rrr]sD      z#OpenrouterConfig.transform_response error_message status_codecCt|||dS)NrJrbrOr)r*rarbrOrrrget_error_classs z OpenrouterConfig.get_error_classFstreaming_response sync_streamcCrc)N)rfrgr[)(OpenRouterChatCompletionStreamingHandler)r*rfrgr[rrrget_model_response_iterators z,OpenrouterConfig.get_model_response_iteratorr6)NN)F)rrrstrr'r#r(boolr4r=rr rrr@rMrRhttpxResponserrr]intr ZHeadersr rerrri __classcell__rrr+rr"s   ,)     8   rc@seZdZdedefddZdS)rhchunkr!c Cszbd|vr6|d}td|d|di|dd|d|did}t|d|d|dd id g}|d D]}|d d |d d<||qs  (      ^