o ưi!@sddlZddlmZmZmZmZmZmZmZm Z m Z ddl Z ddl m Z ddlmZddlmZddlmZGdddeZdS) N) Any CoroutineListLiteralOptionalTupleUnioncastoverload)MIN_NON_ZERO_TEMPERATURE)OpenAIGPTConfigget_secret_str)AllMessageValuescseZdZUdZedeefddZdZee e d<dZ ee ee fe d<dZeee d<dZee e d <dZee e d <dZee e d <dZee e d <dZee eefe d <dZee e d<dZee e d<dZee e d<dZeee d<dZee ee fe d<             d-dee dee ee fdeed ee d ee d ee d ee d ee eefdee dee dee deedee ee fddfddZefddZdefddZde de dedede f ddZde e!de e!fd d!Z"e#de e!ded"e$d#de%e&e&e e!ffd$d%Z'e# &d.de e!ded"e$d&de e!fd'd%Z' &d.de e!ded"ede e e!e%e&e&e e!ffffd(d% Z'd)eed*eede(eeeeffd+d,Z)Z*S)/DeepInfraConfigz Reference: https://deepinfra.com/docs/advanced/openai_api The class `DeepInfra` provides configuration for the DeepInfra's Chat Completions API interface. Below are the parameters: returncCsdS)NZ deepinfra)selfrra/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/deepinfra/chat/transformation.pycustom_llm_providersz#DeepInfraConfig.custom_llm_providerNfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_presponse_formattools tool_choicecCs>t}|D]\}}|dkr|durt|j||q dS)Nr)localscopyitemssetattr __class__)rrrrrrrrrrrr r!r"Zlocals_keyvaluerrr__init__#s zDeepInfraConfig.__init__cs tSN)super get_config)clsr'rrr-8s zDeepInfraConfig.get_configmodelcCs&gd}tj||jdr|d|S)N)streamrrrrrmax_completion_tokensrrrrrr r!r")r0rZreasoning_effort)litellmZsupports_reasoningrappend)rr0supported_openai_paramsrrrget_supported_openai_params<s z+DeepInfraConfig.get_supported_openai_paramsnon_default_paramsoptional_params drop_paramscCs|j|d}|D]K\}}|dkr|dkr|dkrt}|dkr@|dkr?|dkr?tjdus1|dur4d}q tjjd |d d q |d krI||d <q ||vrU|durU|||<q |S)N)r0rrz"mistralai/Mistral-7B-Instruct-v0.1r"autononeTz{Deepinfra doesn't support tool_choice={}. To drop unsupported openai params from the call, set `litellm.drop_params = True`i)message status_coder2r)r6r%r r3r9utilsZUnsupportedParamsErrorformat)rr7r8r0r9r5paramr)rrrmap_openai_paramsVs0  z!DeepInfraConfig.map_openai_paramsmessagescCs|D]?}|ddkrA|d}t|trAt|dkr:t|dtr:|dddkr:d|dvr:|dd|d<qt||d<q|S)a Transform tool message content from array to string format for DeepInfra compatibility. DeepInfra requires tool message content to be a string, not an array. This method converts tool message content from array format to string format. Example transformation: - Input: {"role": "tool", "content": [{"type": "text", "text": "20"}]} - Output: {"role": "tool", "content": "20"} Or if content is complex: - Input: {"role": "tool", "content": [{"type": "text", "text": "result"}]} - Output: {"role": "tool", "content": "[{"type": "text", "text": "result"}]"} ZroleZtoolcontentrtypetext)get isinstancelistlendictjsondumps)rrBr<rCrrr_transform_tool_message_contentzs     z/DeepInfraConfig._transform_tool_message_contentis_asyncTcCdSr+rrrBr0rOrrr_transform_messagesz#DeepInfraConfig._transform_messagesFcCrPr+rrQrrrrRrScsB|rfdd}|Stjttddd}|S)zv Transform messages for DeepInfra compatibility. Handles both sync and async transformations. cs6ttjttddd}|IdH}|S)NTrBr0rO)r,rrRr rrN) parent_resultZtransformed_messages)r'rBr0rrr_async_transforms    z=DeepInfraConfig._transform_messages.._async_transformFrT)r,rRr rrN)rrBr0rOrVrUr/)rBr0rrrRs api_baseapi_keycCs$|ptdpd}|p td}||fS)NZDEEPINFRA_API_BASEz#https://api.deepinfra.com/v1/openaiZDEEPINFRA_API_KEYr )rrWrXZdynamic_api_keyrrr$_get_openai_compatible_provider_infos z4DeepInfraConfig._get_openai_compatible_provider_info) NNNNNNNNNNNNN)F)+__name__ __module__ __qualname____doc__propertyrstrrrint__annotations__rrrKrrIrrrrrrrr r!r"r* classmethodr-r6boolrArrrNr rrrrRrrY __classcell__rrr/rr s        $$  r)rLtypingrrrrrrrr r r3Zlitellm.constantsr Z+litellm.llms.openai.chat.gpt_transformationr Zlitellm.secret_managers.mainrZlitellm.types.llms.openairrrrrrs,