o ưi@szdZddlmZmZmZddlmZddlmZm Z ddl m Z m Z m Z mZddlmZdd lmZGd d d eeZd S) z Support for gpt model family )ListOptionalUnion)BaseTextCompletionConfig)AllMessageValuesOpenAITextCompletionUserMessage)ChoicesMessage ModelResponseTextCompletionResponse)OpenAIGPTConfig_transform_promptcseZdZUdZdZeeed<dZee ed<dZ eeed<dZ ee ed<dZ eeed<dZeeed<dZeeed <dZeeed <dZeeeefed <dZeeed <            d deedee deedee deedeed eed eed eeeefd eed eedeeddfddZefddZ  d!deedeefddZdedefddZdedeeeee fde de de f ddZ!Z"S)"OpenAITextCompletionConfiga Reference: https://platform.openai.com/docs/api-reference/completions/create The class `OpenAITextCompletionConfig` provides configuration for the OpenAI's text completion API interface. Below are the parameters: - `best_of` (integer or null): This optional parameter generates server-side completions and returns the one with the highest log probability per token. - `echo` (boolean or null): This optional parameter will echo back the prompt in addition to the completion. - `frequency_penalty` (number or null): Defaults to 0. It is a numbers from -2.0 to 2.0, where positive values decrease the model's likelihood to repeat the same line. - `logit_bias` (map): This optional parameter modifies the likelihood of specified tokens appearing in the completion. - `logprobs` (integer or null): This optional parameter includes the log probabilities on the most likely tokens as well as the chosen tokens. - `max_tokens` (integer or null): This optional parameter sets the maximum number of tokens to generate in the completion. - `n` (integer or null): This optional parameter sets how many completions to generate for each prompt. - `presence_penalty` (number or null): Defaults to 0 and can be between -2.0 and 2.0. Positive values increase the model's likelihood to talk about new topics. - `stop` (string / array / null): Specifies up to 4 sequences where the API will stop generating further tokens. - `suffix` (string or null): Defines the suffix that comes after a completion of inserted text. - `temperature` (number or null): This optional parameter defines the sampling temperature to use. - `top_p` (number or null): An alternative to sampling with temperature, used for nucleus sampling. Nbest_ofechofrequency_penalty logit_biaslogprobs max_tokensnpresence_penaltystopsuffix temperaturetop_preturnc Cs>t} | D]\}}|dkr|durt|j||q dS)Nself)localscopyitemssetattr __class__)rrrrrrrrrrrrrZlocals_keyvaluer'd/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/openai/completion/transformation.py__init__9s z#OpenAITextCompletionConfig.__init__cs tS)N)super get_config)clsr$r'r(r+Ms z%OpenAITextCompletionConfig.get_configresponse_objectmodel_response_objectc Csz]|dus |dur tdg}t|dD]\}}t|ddd}t|d|||ddd}||q||_d |vrDt|d |d d |vrM|d |_d |vrV|d |_ ||j d <|WSt yk}z|d}~ww) NzError in response object formatchoicestextZ assistant)contentZrole finish_reasonr)r3indexmessagerusageidmodeloriginal_response) ValueError enumerater rgetappendr0r#r7r8Z_hidden_params Exception)rr.r/Z choice_listidxchoicer5er'r'r(%convert_to_chat_model_response_objectQs<    z@OpenAITextCompletionConfig.convert_to_chat_model_response_objectr8cCsgdS)N)Z functionsZ function_callrrrstreamZstream_optionsrrrrruserZresponse_formatseedZtoolsZ tool_choice max_retriesrZ top_logprobs extra_headersr')rr8r'r'r(get_supported_openai_paramsysz6OpenAITextCompletionConfig.get_supported_openai_paramsmessagesoptional_paramsheaderscCst|}||d|S)N)r8promptr)rr8rIrJrKrLr'r'r(!transform_text_completion_requests zs