o ưiy @sddlZddlZddlmZmZmZmZmZmZm Z m Z ddl Z ddl m Z mZmZmZddlZddlmZddlmZddlmZddlmZddlmZdd lmZdd lmZdd l m!Z!eZ"Gd d d eZ#de e j$e%fde%fddZ& d1de'de'de'de'dege'ff ddZ( d1de'de'de'de'dege'ff ddZ)   d2de'dee'dee'dee'de'f d d!Z*d"e%fd#d$Z+d%edee'fd&d'Z,Gd(d)d)eZ-Gd*d+d+eZ.   d2d,ee'd-ee'd.ee'de.fd/d0Z/dS)3N)AnyCallableDictLiteral NamedTupleOptionalUnioncast)AsyncAzureOpenAI AsyncOpenAI AzureOpenAIOpenAI)verbose_logger) DualCache)BaseLLMException) BaseOpenAILLM)get_azure_ad_token_provider)get_secret_str)GenericLiteLLMParams)_add_path_to_api_basec sVeZdZ    ddeejdeejdeeeje fdee ffdd Z Z S) AzureOpenAIErrorNrequestresponseheadersbodycstj||||||ddS)N) status_codemessagerrrr)super__init__)selfrrrrrr __class__V/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/azure/common_utils.pyrs  zAzureOpenAIError.__init__)NNNN) __name__ __module__ __qualname__rhttpxRequestResponserHeadersdictr __classcell__r"r"r r#rsrrreturncCsri}d|vr |d|d<d|vr|d|d<d|vr |d|d<d|vr*|d|d<dd|D}i||S)Nzx-ratelimit-limit-requestszx-ratelimit-remaining-requestszx-ratelimit-limit-tokenszx-ratelimit-remaining-tokenscSsi|] \}}dd||qS)z{}-{}Z llm_provider)format).0kvr"r"r# ;sz)process_azure_headers..)items)rZopenai_headersZllm_response_headersr"r"r#process_azure_headers+s&  r4,https://cognitiveservices.azure.com/.default tenant_id client_id client_secretscopec Csddlm}m}td|drt|}n|}|dr#t|}n|}|dr/t|}n|}td||||dusE|dusE|durItd||||} td| || |} td | | S) z Get Azure AD token provider from `client_id`, `client_secret`, and `tenant_id` Args: tenant_id: str client_id: str client_secret: str scope: str Returns: callable that returns a bearer token. r)ClientSecretCredentialget_bearer_token_providerz$Getting Azure AD Token from Entra IDz os.environ/z,tenant_id %s, client_id %s, client_secret %sNz8tenant_id, client_id, and client_secret must be provided credential %stoken_provider %s)azure.identityr:r;rdebug startswithr ValueError) r6r7r8r9r:r;Z _tenant_idZ _client_idZ_client_secret credentialtoken_providerr"r"r# get_azure_ad_token_from_entra_idBs0           rDazure_usernameazure_passwordcCsTddlm}m}td|||||||d}td||||}td||S)a Get Azure AD token provider from `client_id`, `azure_username`, and `azure_password` Args: client_id: str azure_username: str azure_password: str scope: str Returns: callable that returns a bearer token. r)UsernamePasswordCredentialr;z2client_id %s, azure_username %s, azure_password %s)r7usernamepasswordr<r=)r>rGr;rr?)r7rErFr9rGr;rBrCr"r"r#)get_azure_ad_token_from_username_passwordzs    rJazure_ad_tokenazure_client_idazure_tenant_idc Cs8|durd}tdd}|ptd}|ptd}|dus"|dur(tddd t|}|dur6td d d t||||d }t|}|durK|Stj }|j |d |d|d|d|dd} | j dkrnt| j | j d | } | dd}| dd} |durtddd | durtddd tj||| d|S)z Get Azure AD token from OIDC token Args: azure_ad_token: str azure_client_id: Optional[str] azure_tenant_id: Optional[str] scope: str Returns: `azure_ad_token_access_token` - str Nr5ZAZURE_AUTHORITY_HOSTz!https://login.microsoftonline.comAZURE_CLIENT_IDAZURE_TENANT_IDiz/AZURE_CLIENT_ID and AZURE_TENANT_ID must be set)rriz6OIDC token could not be retrieved from secret manager.)rLrMazure_authority_host oidc_token/z/oauth2/v2.0/tokenZclient_credentialsz6urn:ietf:params:oauth:client-assertion-type:jwt-bearer)r7Z grant_typer9Zclient_assertion_typeZclient_assertion)dataZ access_tokenZ expires_inz(Azure AD Token access_token not returnedz&Azure AD Token expires_in not returned)keyvaluettl)osgetenvrrjsondumpsazure_ad_cacheZ get_cachelitellmZmodule_level_clientpostrtextgetZ set_cache) rKrLrMr9rPrQZazure_ad_token_cache_keyZazure_ad_token_access_tokenclientZ req_tokenZazure_ad_token_jsonZazure_ad_token_expires_inr"r"r#get_azure_ad_token_from_oidcsx    rbazure_client_paramscCs2|dd}|durd|vr||d<|d|S)Nazure_endpointz/openai/deploymentsbase_url)r`pop)rcrdr"r"r#!select_azure_base_url_or_endpoints  rglitellm_paramsc Csn|d}|dp td}|dptd}|dp!td}|dp+td }|d p5td }|d p?td }|dpJtdd}|durQd}|durh|rh|rh|rhtdt||||d}|dur|r|r|rtdt||||d}|r|r|r|drtdt ||||d}nJ|durt j durtdzt |d}Wn&t ytdYnty} z tdt| d| d} ~ ww|dur|durtj|d}|r5t|r5z!|} t| tstd t| td!t| | }W|Styty4} ztdt| td"t| | d} ~ ww|S)#a Get Azure AD token from various authentication methods. This function tries different methods to obtain an Azure AD token: 1. From an existing token provider 2. From Entra ID using tenant_id, client_id, and client_secret 3. From username and password 4. From OIDC token 5. From a service principal with secret workflow 6. From DefaultAzureCredential Args: litellm_params: Dictionary containing authentication parameters - azure_ad_token_provider: Optional callable that returns a token - azure_ad_token: Optional existing token - tenant_id: Optional Azure tenant ID - client_id: Optional Azure client ID - client_secret: Optional Azure client secret - azure_username: Optional Azure username - azure_password: Optional Azure password Returns: Azure AD token as string if successful, None otherwise azure_ad_token_providerrKZAZURE_AD_TOKENr6rOr7rNr8AZURE_CLIENT_SECRETrEAZURE_USERNAMErFAZURE_PASSWORD azure_scope AZURE_SCOPEr5N:Using Azure AD Token Provider from Entra ID for Azure Authr6r7r8r90Using Azure Username and Password for Azure AuthrErFr7r9oidc/%Using Azure OIDC Token for Azure AuthrKrLrMr9TzvUsing Azure AD token provider based on Service Principal with Secret workflow or DefaultAzureCredential for Azure Authrm*Azure AD Token Provider could not be used.z'Error calling Azure AD token provider: zm. Follow docs - https://docs.litellm.ai/docs/providers/azure/#azure-ad-token-refresh---defaultazurecredential)r9z3Azure AD token provider returned non-string value: z%Azure AD token must be a string, got zFailed to get Azure AD token: )r`rrXrYrr?rDrJr@rbr]enable_azure_ad_token_refreshrrA Exceptionerrorstr BaseAzureLLM*_try_get_default_azure_credential_providercallable isinstancetype TypeError RuntimeError) rhrirKr6r7r8rErFr9etokenr"r"r#get_azure_ad_token s           rc@seZdZededeegeffddZ     d*deedeed eed eee e e e fd ee d ed eedeee e e e ffddZd e deedeedeed eedede fddZ d+ded ed ededeeejfd e deedeedeegefded eee e fdee e ffddZede d eede fddZe d+deed eeeeeeffdeedefd eeeed!fdef d"d#Zed eedefd$d%Zd eeefd&ed'edeefd(d)ZdS),r|r9r-c Cspddlm}tdzt||jd}td|WSty7}ztdt|WYd}~dSd}~ww)z Try to get DefaultAzureCredential provider Args: scope: Azure scope for the token Returns: Token provider callable if DefaultAzureCredential is enabled and available, None otherwise r)AzureCredentialTypez7Attempting to use DefaultAzureCredential for Azure Auth)rmZazure_credentialzJSuccessfully obtained Azure AD token provider using DefaultAzureCredentialzDefaultAzureCredential failed: N)Z9litellm.types.secret_managers.get_azure_ad_token_providerrrr?rZDefaultAzureCredentialryr{)r9rrirr"r"r#r}s z7BaseAzureLLM._try_get_default_azure_credential_providerNFapi_keyapi_base api_versionrarh _is_asyncmodelc Csdd}t} || d<|dur|j| dd} | r!t| ttttfr!| S|j|p&i|||||d} ||rz| d|dd} d| vrH| d| d<d | vrR| d | d <d | vr\| d | d <t d | d |d urrtdi| }n6tdi| }n.|d urtdi| }n"tdi| }n|}|durt|ttfrt|j t r|j d||j|| dd|S)Nis_asyncZazure)client_initialization_params client_type)rhrr model_namerrrz /openai/v1/)rretimeout max_retries http_clientz"Using Azure v1 API with base_url: reT api-version) openai_clientrrr")localsZget_cached_openai_clientrr r r r initialize_azure_sdk_client_is_azure_v1_api_versionr`rr?Z _custom_queryr+ setdefaultZset_cached_openai_client) rrrrrarhrrrrZ cached_clientrcZ v1_paramsr"r"r#get_azure_openai_clientsb       z$BaseAzureLLM.get_azure_openai_clientrrcCs4|d}|d}||dd} ||dd} ||dd} ||d d } ||d d } ||d d}|dur:d}|d}|d}|s]|dur]| r]| r]| r]tdt| | | |d}|durt| rt| rt| rttdt| | | |d}|dur|drtdt|| | |d}n&|s|durtj durtdzt |d}Wnt ytdYnw|durt dtj}|}|durt|tr|ddd}td |d!t|d"||||||d#}|dur||d$<n||d$<|dur||d<|dur ||d<|dur||d<t|d%}|S)&NrirKr6rOr7rNr8rjrErkrFrlrmrnr5rrrorprqrrrsrtruTz\Using Azure AD token provider based on Service Principal with Secret workflow for Azure AuthrvrwAZURE_API_VERSIONz***************z%Initializing Azure OpenAI Client for z , Api Base: z , Api Key:)rrdrrKrir)rc)r`_resolve_env_varrr?rDrJr@rbr]rxrrArXrYZAZURE_DEFAULT_API_VERSIONrr{Z_get_async_http_clientZ_get_sync_http_clientrg)rrhrrrrrrirKr6r7r8rErFr9rrZ_api_keyrcr"r"r#rs           z(BaseAzureLLM.initialize_azure_sdk_clientrrrKri acompletionc Cs|dtd} |dtd} |dtdd}| durr|ds)|d7}||7}||tj||d }|durA||d <n|durV|d rRt|| | |d }||d <| dur^| |d<| durktdi|} | St di|} | S)Nr6rOr7rNrmrnr5rR)rrerrrrrsrurKriTr") r`rXrYendswithr]Zclient_sessionr@rbr r )rrrrrrrhrrKrirrar6r7r9rcr"r"r#,_init_azure_client_for_cloudflare_ai_gatewaywsD     z9BaseAzureLLM._init_azure_client_for_cloudflare_ai_gatewayrcCsf|pt}d|vr |S|jptjptjptdptd}|r$||d<|St|}|r1d||d<|S)Nzapi-keyAZURE_OPENAI_API_KEY AZURE_API_KEYzBearer Authorization)rrr] azure_keyrr)rrhrrKr"r"r# _base_validate_azure_environments& z-BaseAzureLLM._base_validate_azure_environmentroute)z/openai/responsesz/openai/vector_storesdefault_api_version)latestpreviewc Cs|ptjptd}|durtd|dt|}|pi}ttt| dp)|}t |j }d|vr9|r9||d<||vrDt ||d}n|}t |rad|vrat|}t|j|jd dd }t|j|d } t| S) a} Get the base Azure URL for the given route and API version. Args: api_base: The base URL of the Azure API. litellm_params: The litellm parameters. route: The route to the API. default_api_version: The default API version to use if no api_version is provided. If 'latest', it will use `openai/v1/...` route. AZURE_API_BASENz^api_base is required for Azure AI Studio. Please set the api_base parameter. Passed `api_base=`rr)rZ ending_pathz /openai/v1z/openai)path)params)r]rrrAr'URLr rr{r`r+rrr|r copy_withrreplace) rrhrr original_urlrZ query_paramsnew_url parsed_urlZ final_urlr"r"r#_get_base_azure_urls4       z BaseAzureLLM._get_base_azure_urlcCs|durdS|dvS)NF>rv1rr")rr"r"r#rsz%BaseAzureLLM._is_azure_v1_api_version param_key env_var_keycCs ||}|dur |St|S)a)Resolve the environment variable for a given parameter key. The logic here is different from `params.get(key, os.getenv(env_var))` because litellm_params may contain the key with a None value, in which case we want to fallback to the environment variable. N)r`rXrY)rrhrrZ param_valuer"r"r#r s  zBaseAzureLLM._resolve_env_var)NNNFN)N)r$r%r& staticmethodr{rrr}rr r r r r+boolrrintfloatr'Timeoutrrrrrrrrrr"r"r"r#r|s # K       6  :*r|c@s2eZdZUeeed<eeed<eeed<dS)AzureCredentialsrrrN)r$r%r&rr{__annotations__r"r"r"r#rs  rrrrcCsR|ptjptd}|ptjptd}|p!tjp!tjp!tdp!td}t|||dS)zEResolve Azure credentials from params, litellm globals, and env vars.rrrr)rrr)r]rrrrrr)rrrZresolved_api_baseZresolved_api_versionZresolved_api_keyr"r"r#get_azure_credentialss0r)r5)NNN)0rZrXtypingrrrrrrrr r'Zopenair r r r r]Zlitellm._loggingrZlitellm.caching.cachingrZ)litellm.llms.base_llm.chat.transformationrZ litellm.llms.openai.common_utilsrZ3litellm.secret_managers.get_azure_ad_token_providerrZlitellm.secret_managers.mainrZlitellm.types.routerrZ litellm.utilsrr\rr*r+r4r{rDrJrbrgrr|rrr"r"r"r#s(          <  + ^