o ưi&@sddlmZmZmZmZmZmZmZddlZddl Z ddl m Z ddl m Z ddlmZmZddlmZddlmZddlmZmZmZmZmZd d lmZmZGd d d eZGd ddeZdS))Any AsyncIteratorIteratorListOptionalTupleUnionN)verbose_logger) XAI_API_BASE)filter_value_from_dictstrip_name_from_messages)get_secret_str)AllMessageValues)Choices ModelResponseModelResponseStreamPromptTokensDetailsWrapperUsage)$OpenAIChatCompletionStreamingHandlerOpenAIGPTConfigcseZdZedeefddZdeedeedeeeeeffddZdede fd d Z dede fd d Z dede fd dZ d+dededede def ddZ d+deeeeeefde dee defddZdedeededededef fdd Zededd fd!d"Z d,ded#ejd$ed%edeedededeedee deffd&d' Zd$ed(edd fd)d*ZZ S)- XAIChatConfigreturncCsdS)NZxai)selfrr[/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/xai/chat/transformation.pycustom_llm_providersz!XAIChatConfig.custom_llm_providerapi_baseapi_keycCs$|ptdpt}|p td}||fS)Nr Z XAI_API_KEY)r r )rrrZdynamic_api_keyrrr$_get_openai_compatible_provider_info!s z2XAIChatConfig._get_openai_compatible_provider_infomodelc Csgd}||r|d||r|dztj||jdr)|dW|SW|StyF}ztd|WYd}~|Sd}~ww)N)Z logit_biasZlogprobs max_tokensnZpresence_penaltyZresponse_formatseedstreamZstream_optionsZ temperatureZ tool_choicetoolsZ top_logprobsZtop_puserZweb_search_optionsstopZfrequency_penalty)r rZreasoning_effortz,Error checking if model supports reasoning: ) _supports_stop_reasonappend_supports_frequency_penaltylitellmZsupports_reasoningr Exceptionr debug)rr Zbase_openai_paramserrrget_supported_openai_params(s$     z)XAIChatConfig.get_supported_openai_paramscCs(d|vrdSd|vr dSd|vrdSdS)Nz grok-3-miniFgrok-4grok-code-fastTrrr rrrr(Vsz#XAIChatConfig._supports_stop_reasoncCsd|vrdSd|vr dSdS)z From manual testing grok-4 does not support `frequency_penalty` When sent the model fails from xAI API r0Fr1Trr2rrrr*_s z)XAIChatConfig._supports_frequency_penaltyFnon_default_paramsoptional_params drop_paramsc Cs|j|d}|D]A\}}|dkr||d<q |dkr?|dur?g}|D]} t| d} | dur3|| q#t|dkr>||d<q ||vrK|durK|||<q |S)N)r Zmax_completion_tokensr!r%strictr)r/itemsr r)len) rr3r4r r5Zsupported_openai_paramsparamvaluer%Ztoolrrrmap_openai_paramsks&     zXAIChatConfig.map_openai_paramsstreaming_response sync_stream json_modecCst|||dS)N)r<r=r>)!XAIChatCompletionStreamingHandler)rr<r=r>rrrget_model_response_iterators z)XAIChatConfig.get_model_response_iteratormessageslitellm_paramsheaderscst|}t|||||S)zp Handle https://github.com/BerriAI/litellm/issues/9720 Filter out 'name' from messages )r supertransform_request)rr rAr4rBrC __class__rrrEs  zXAIChatConfig.transform_requestchoiceNcCs8|jdkr|jjrt|jjdkrd|_dSdSdSdS)z Helper to fix finish_reason for tool calls when XAI API returns empty string. XAI API returns empty string for finish_reason when using tools, so we need to set it to "tool_calls" when tool_calls are present. r tool_callsN) finish_reasonmessagerJr8)rHrrr(_fix_choice_finish_reason_for_tool_callss  z6XAIChatConfig._fix_choice_finish_reason_for_tool_calls raw_responsemodel_response request_datac  stj||||||||| | | d } | jr$| jD] } t| tr#|| qz |}|| |W| StyL}zt d|WYd}~| Sd}~ww)a2 Transform the response from the XAI API. XAI API returns empty string for finish_reason when using tools, so we need to fix this after the standard OpenAI transformation. Also handles X.AI web search usage tracking by extracting num_sources_used. ) r rNrO logging_objrPrAr4rBencodingrr>z(Error extracting X.AI web search usage: N) rDtransform_responsechoices isinstancerrMjson)_enhance_usage_with_xai_web_search_fieldsr,r r-)rr rNrOrQrPrAr4rBrRrr>responserHraw_response_jsonr.rFrrrSs6   z XAIChatConfig.transform_responserYcCst|dr |jdur dS|j}d}|di}t|tr%d|vr%|d}|durN|dkrP|jdur6t|_t||j_t |dt|t d|dSdSdS)z` Extract num_sources_used from X.AI response and map it to web_search_requests. usageNnum_sources_usedrzX.AI web search sources used: ) hasattrrZgetrUdictZprompt_tokens_detailsrintZweb_search_requestssetattrr r-)rrOrYrZr[Zresponse_usagerrrrWs    z7XAIChatConfig._enhance_usage_with_xai_web_search_fields)F)NN)!__name__ __module__ __qualname__propertyrstrrrrlistr/boolr(r*r^r;rrrrrr@rrrE staticmethodrrMhttpxResponserSrW __classcell__rrrFrrs .        4rcs&eZdZdedeffdd ZZS)r?chunkrcs>|dg}t|dkrd|vrdiddg|d<t|S)a Handle xAI-specific streaming behavior. xAI Grok sends a final chunk with empty choices array but with usage data when stream_options={"include_usage": True} is set. Example from xAI API: {"id":"...","object":"chat.completion.chunk","created":...,"model":"grok-4-1-fast-non-reasoning", "choices":[],"usage":{"prompt_tokens":171,"completion_tokens":2,"total_tokens":173,...}} rTrrZN)indexdeltarK)r]r8rD chunk_parser)rrlrTrFrrros  z.XAIChatCompletionStreamingHandler.chunk_parser)rarbrcr^rrorkrrrFrr?sr?) typingrrrrrrrrir+Zlitellm._loggingr Zlitellm.constantsr Z8litellm.litellm_core_utils.prompt_templates.common_utilsr r Zlitellm.secret_managers.mainr Zlitellm.types.llms.openairZlitellm.types.utilsrrrrrZopenai.chat.gpt_transformationrrrr?rrrrs$    `