o ưi2@sdZddlmZmZmZmZmZmZmZm Z m Z m Z m Z ddl Z ddlmZddlmZddlmZddlZddlmZddlmZdd lmZdd lmZmZmZm Z dd l!m"Z"m#Z#d d l$m%Z%Gddde%Z&GdddeZ'dS)zQ Translate from OpenAI's `/v1/chat/completions` to Groq's `/v1/chat/completions` ) Any CoroutineListLiteralOptionalTupleUnioncastoverloadIterator AsyncIteratorN)$OpenAIChatCompletionStreamingHandler) OpenAIError) BaseModel)verbose_logger)Loggingget_secret_str)AllMessageValuesChatCompletionAssistantMessageChatCompletionToolParam$ChatCompletionToolParamFunctionChunk) ModelResponseModelResponseStream)OpenAILikeChatConfigcseZdZUdZeeed<dZeee e fed<dZ ee ed<dZ ee ed<dZeeed<dZeeed<dZeeed<dZeee e fed <dZeeed <dZeeed <dZee ed <dZee ed <dZeee e fed<             dAdeedeee e fdee dee deedeedeed eee e fd eed eed ee d ee deee e fddfddZedee fddZefddZ dBdeee ee efdedeede fddZ!de de ffdd Z"e#de$e%de d e&d!de'e e e$e%ffd"d#Z(e# dBde$e%de d e&dde$e%fd$d#Z( dBde$e%de d edee$e%e'e e e$e%ffffd%d# Z(d&ee d'ee de)ee ee ffd(d)Z*d*e defd+d,Z+d-e fd.d/Z,  dCd0e d*e de d1ed2ede f fd3d4 Z-  dDde d5e.j/d6ed7e0d8e de$e%d*e d9e d:e d'ee deedeffd;d< Z1d=ee de&d>fd?d@Z2Z3S)EGroqChatConfigNfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_presponse_formattools tool_choicereturncCs>t}|D]\}}|dkr|durt|j||q dS)Nself)localscopyitemssetattr __class__)r+rrrr r!r"r#r$r%r&r'r(r)Zlocals_keyvaluer3\/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/groq/chat/transformation.py__init__9s zGroqChatConfig.__init__cCsdS)Ngroqr3)r+r3r3r4custom_llm_providerNsz"GroqChatConfig.custom_llm_providercs tSN)super get_config)clsr0r3r4r:Rs zGroqChatConfig.get_configFstreaming_response sync_stream json_modecCst|||dS)N)r=r>r?)"GroqChatCompletionStreamingHandler)r+r=r>r?r3r3r4get_model_response_iteratorVs z*GroqChatConfig.get_model_response_iteratormodelc st|}z|dWn tyYnwztj||jdr(|dW|SW|StyE}zt d|WYd}~|Sd}~ww)N max_retriesrBr7Zreasoning_effortz,Error checking if model supports reasoning: ) r9get_supported_openai_paramsremove ValueErrorlitellmZsupports_reasoningr7append Exceptionrdebug)r+rBZ base_paramser<r3r4rEbs&   z*GroqChatConfig.get_supported_openai_paramsmessagesis_asyncTcCdSr8r3r+rMrBrNr3r3r4_transform_messagesssz"GroqChatConfig._transform_messagescCrOr8r3rPr3r3r4rQysc st|D]4\}} t|tr|}n|}|ddk}|r8tdd}|D] \} } | dur3| || <q'|||<q|rDtj||ddStj||ddS)NroleZ assistant)rRT)rMrBrNF) enumerate isinstancerZ model_dumpgetrr.r9rQ) r+rMrBrNidxmessage_messageZassistant_messageZ new_messagekvr<r3r4rQs*   api_baseapi_keycCs$|ptdpd}|p td}||fS)NZ GROQ_API_BASEzhttps://api.groq.com/openai/v1Z GROQ_API_KEYr)r+r[r\Zdynamic_api_keyr3r3r4$_get_openai_compatible_provider_infos z3GroqChatConfig._get_openai_compatible_provider_infooptional_paramscCs|ddur dSdS)zH Groq doesn't support 'response_format' while streaming r'NTF)rU)r+r^r3r3r4_should_fake_streamsz"GroqChatConfig._should_fake_stream json_schemacCstdtd|ddS)a3 Handles creating a tool call for getting responses in JSON format. Args: json_schema (Optional[dict]): The JSON schema the response should be in Returns: AnthropicMessagesTool: The tool call to send to Anthropic API to get responses in JSON format functionjson_tool_call)name parameterstypera)rr)r+r`r3r3r4*_create_json_tool_call_for_response_formats z9GroqChatConfig._create_json_tool_call_for_response_formatnon_default_params drop_params-replace_max_completion_tokens_with_max_tokensc s|d}||rd|d<|durht|trhd}d|vr"|d}n d|vr,|dd} |durhtj|ddshd |vrHtjd |d |dd d ddid}|j|d} | g|d <||d<d|d<|ddt ||||}|S)Nr'TZ fake_streamZresponse_schemar`Zschemar6rDr(z Groq model 'as' does not support native structured outputs. LiteLLM uses a tool-calling workaround for structured outputs on this model, which is incompatible with user-provided tools. Either use a model that supports native structured outputs (e.g., gpt-oss-120b, llama-4, kimi-k2), or remove the tools parameter. See: https://console.groq.com/docs/structured-outputs#supported-models)rWrBZ llm_providerrarcrbre)r`r)r?) rUr_rTdictrHZsupports_response_schemaZBadRequestErrorrgpopr9map_openai_params) r+rhr^rBrirjZ_response_formatr`Z _tool_choiceZ_toolr<r3r4rmsH        z GroqChatConfig.map_openai_params raw_responsemodel_response logging_obj request_datalitellm_paramsencodingc sDtj||||||||| | | d }|jt|dd} t|d| |S)N) rBrnrorprqrMr^rrrsr\r?Z service_tier)original_service_tier)r9transform_response_map_groq_service_tiergetattrr/) r+rBrnrorprqrMr^rrrsr\r?Zmapped_service_tierr<r3r4ru s& z!GroqChatConfig.transform_responsertautodefaultZflexcCs&|durdS|dvr dSttd|S)z@ Ensure groq service tier is OpenAI compatible. Nryrx)r r)r+rtr3r3r4rv0s z%GroqChatConfig._map_groq_service_tier) NNNNNNNNNNNNN)F)FF)NN)4__name__ __module__ __qualname__rrint__annotations__rrstrrkrlistr r!r"r#r$r%r&r'r(r)r5propertyr7 classmethodr:r r rboolrrArEr rrrrrQrr]r_rgrmhttpxResponseLiteLLMLoggingObjrurv __classcell__r3r3r<r4r*s@                O     $rcs&eZdZdedeffdd ZZS)r@chunkr*csl|d}|rt|d|d|d|dg}|D]}|di}d|vr/|d|d<qt|S) NerrorcoderW) status_coderWbodychoicesdeltaZ reasoningZreasoning_content)rUrrlr9 chunk_parser)r+rrrchoicerr<r3r4r?s    z/GroqChatCompletionStreamingHandler.chunk_parser)r{r|r}rkrrrr3r3r<r4r@>sr@)(__doc__typingrrrrrrrr r r r rZ+litellm.llms.openai.chat.gpt_transformationr Z litellm.llms.openai.common_utilsrZpydanticrrHZlitellm._loggingrZ*litellm.litellm_core_utils.litellm_loggingrrZlitellm.secret_managers.mainrZlitellm.types.llms.openairrrrZlitellm.types.utilsrrZopenai_like.chat.transformationrrr@r3r3r3r4s"4