o ưi1 @sddlZddlZddlZddlmZmZddlZddlZddlm Z m Z m Z m Z Gddde ZGdddZdd Z   dd ed ed ed e dedef ddZddZdS)N)CallableOptional)ChoicesMessage ModelResponseUsagecseZdZfddZZS)AlephAlphaErrorcs@||_||_tjddd|_tj||jd|_t|jdS)NPOSTz$https://api.aleph-alpha.com/complete)methodurl) status_coderequest) r messagehttpxRequestr Responseresponsesuper__init__)selfr r __class__d/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/deprecated_providers/aleph_alpha.pyr szAlephAlphaError.__init__)__name__ __module__ __qualname__r __classcell__rrrrr srcA@sVeZdZUdZejZeee d<dZ eee d<dZ ee e d<dZ eee d<dZeee d<dZeee d<dZeee d <dZeee d <dZeee d <dZeee d <dZee e d <dZee e d<dZee e d<dZee e d<dZee e d<dZeee d<dZee e d<dZeee d<dZeee d<dZeee d<dZ eee d<dZ!ee"e d<dZ#ee e d<dZ$ee e d<dZ%ee e d<dZ&ee"e d<dZ'ee"e d<dZ(ee e d<dZ)ee e d<dZ*eee d <dZ+ee e d!<                               d'deedeedee deedeedeed eed eed eed eed ee dee dee dee dee deedee deedeedeedeedee"dee dee dee dee"dee"dee dee d eed!ee d"df@d#d$Z,e-d%d&Z.dS)(AlephAlphaConfiga Reference: https://docs.aleph-alpha.com/api/complete/ The `AlephAlphaConfig` class represents the configuration for the Aleph Alpha API. Here are the properties: - `maximum_tokens` (integer, required): The maximum number of tokens to be generated by the completion. The sum of input tokens and maximum tokens may not exceed 2048. - `minimum_tokens` (integer, optional; default value: 0): Generate at least this number of tokens before an end-of-text token is generated. - `echo` (boolean, optional; default value: false): Whether to echo the prompt in the completion. - `temperature` (number, nullable; default value: 0): Adjusts how creatively the model generates outputs. Use combinations of temperature, top_k, and top_p sensibly. - `top_k` (integer, nullable; default value: 0): Introduces randomness into token generation by considering the top k most likely options. - `top_p` (number, nullable; default value: 0): Adds randomness by considering the smallest set of tokens whose cumulative probability exceeds top_p. - `presence_penalty`, `frequency_penalty`, `sequence_penalty` (number, nullable; default value: 0): Various penalties that can reduce repetition. - `sequence_penalty_min_length` (integer; default value: 2): Minimum number of tokens to be considered as a sequence. - `repetition_penalties_include_prompt`, `repetition_penalties_include_completion`, `use_multiplicative_presence_penalty`,`use_multiplicative_frequency_penalty`,`use_multiplicative_sequence_penalty` (boolean, nullable; default value: false): Various settings that adjust how the repetition penalties are applied. - `penalty_bias` (string, nullable): Text used in addition to the penalized tokens for repetition penalties. - `penalty_exceptions` (string[], nullable): Strings that may be generated without penalty. - `penalty_exceptions_include_stop_sequences` (boolean, nullable; default value: true): Include all stop_sequences in penalty_exceptions. - `best_of` (integer, nullable; default value: 1): The number of completions will be generated on the server side. - `n` (integer, nullable; default value: 1): The number of completions to return. - `logit_bias` (object, nullable): Adjust the logit scores before sampling. - `log_probs` (integer, nullable): Number of top log probabilities for each token generated. - `stop_sequences` (string[], nullable): List of strings that will stop generation if they're generated. - `tokens` (boolean, nullable; default value: false): Flag indicating whether individual tokens of the completion should be returned or not. - `raw_completion` (boolean; default value: false): if True, the raw completion of the model will be returned. - `disable_optimizations` (boolean, nullable; default value: false): Disables any applied optimizations to both your prompt and completion. - `completion_bias_inclusion`, `completion_bias_exclusion` (string[], default value: []): Set of strings to bias the generation of tokens. - `completion_bias_inclusion_first_token_only`, `completion_bias_exclusion_first_token_only` (boolean; default value: false): Consider only the first token for the completion_bias_inclusion/exclusion. - `contextual_control_threshold` (number, nullable): Control over how similar tokens are controlled. - `control_log_additive` (boolean; default value: true): Method of applying control to attention scores. maximum_tokensNminimum_tokensecho temperaturetop_ktop_ppresence_penaltyfrequency_penaltysequence_penaltysequence_penalty_min_length#repetition_penalties_include_prompt'repetition_penalties_include_completion#use_multiplicative_presence_penalty$use_multiplicative_frequency_penalty#use_multiplicative_sequence_penalty penalty_bias)penalty_exceptions_include_stop_sequencesbest_ofn logit_bias log_probsstop_sequencestokensraw_completiondisable_optimizationscompletion_bias_inclusioncompletion_bias_exclusion*completion_bias_inclusion_first_token_only*completion_bias_exclusion_first_token_onlycontextual_control_thresholdcontrol_log_additivereturnc #Cs>t} | D]\}!}"|!dkr|"durt|j|!|"q dS)Nr)localscopyitemssetattrr)#rrr r!r"r#r$r%r&r'r(r)r*r+r,r-r.r/r0r1r2r3r4r5r6r7r8r9r:r;r<r=Zlocals_keyvaluerrrrrs "zAlephAlphaConfig.__init__cCsdd|jDS)NcSs>i|]\}}|dst|tjtjttfs|dur||qS)__N) startswith isinstancetypes FunctionTypeBuiltinFunctionType classmethod staticmethod).0kvrrr s   z/AlephAlphaConfig.get_config..)__dict__rA)clsrrr get_configszAlephAlphaConfig.get_config)NNNNNNNNNNNNNNNNNNNNNNNNNNNNNNN)/rrr__doc__litellmZ max_tokensrrint__annotations__r r!boolr"r#r$r%r&r'r(r)r*r+r,r-r.strr/r0r1r2dictr3r4listr5r6r7r8r9r:r;r<r=rrKrSrrrrrs  8      ! 'rcCs ddd}|rd||d<|S)Nzapplication/json)acceptz content-typezBearer Authorizationr)api_keyheadersrrrvalidate_environments r`modelmessagesapi_basemodel_response print_verboseoptional_paramsc Cst|} tj} | D] \}}||vr|||<q |}|}d}d|vrqt|D]G\}}d|vrh|dkr>|d|d7}q(|ddkrN|d|d7}q(|ddkr^|d |d7}q(|d |d7}q(||d7}q(n d d d |D}||d|}|j||d|idtjj || t |d|vr|dndd}d|vr|ddur| S|j |||jd|id|d|j| }d|vrt|d|jdz7g}t|dD])\}}t|ddkrt|dd}ntdd}t|d|d|d}||q||_Wntytt ||jdwt||}t|j|ddd dd!d"}tt|_||_t||||d#}t|d$||S)%NcontrolZrolerz###Instruction: contentsystemuserz ###Input: z ###Response:  css|]}|dVqdS)riNr)rMrrrr szcompletion..)rapromptZcomplete_input_dict)inputr^additional_argsstreamF)r_datarqT)ror^original_responserpzraw model_response: error)rr Z completions completion)ri finish_reason)rvindexrchoicesrr)Zdisallowed_special) prompt_tokenscompletion_tokensZ total_tokensusage)r`rUrrSrA enumeratejoinZpre_callZmodule_level_clientpostjsondumps iter_linesZ post_calltextrr lenrrappendry ExceptionencoderVtimecreatedrarrB)rarbrcrdreencodingr^Z logging_objrfZlitellm_paramsZ logger_fnZdefault_max_tokens_to_sampler_configrNrOZcompletion_urlrnidxrrrrZcompletion_responseZ choices_listitemZ message_objZ choice_objrzr{r|rrrrus       rucCsdS)Nrrrrr embedding1sr)NNN)rrrHtypingrrrrUZ litellm.utilsrrrrrrrr`rYr[rZrurrrrrs8  {