o ưi@sUdZddlZddlmZmZddlmZddlmZddlm Z ddl m Z m Z edZ eeed<ed Zeeed <e e jd Zd efd d ZddZdefddZdeefddZdS)z* Helper functions to query prometheus API N)datetime timedelta)Optional) get_secret)verbose_logger)get_async_httpx_clienthttpxSpecialProviderPROMETHEUS_URLPROMETHEUS_SELECTED_INSTANCE)Z llm_provider metric_namecsptdur td|d}tt}tjtd||ddIdH}|}td||dd}|S) N=PROMETHEUS_URL not set please set 'PROMETHEUS_URL=<>' in .envz[24h]z /api/v1/query)querytimeparams+json response from prometheus /query api %sdataresult) r ValueErrorintrasync_http_handlergetjsonrdebug)r r nowresponse_json_responseresultsrm/home/app/Keep/.python/lib/python3.10/site-packages/litellm/integrations/prometheus_helpers/prometheus_api.pyget_metric_from_prometheuss    r c sd}ddg}|D]a}t|dIdH}|rdtd||D]F}td||d}|d }|d }tdur=|d tkr=qtt|d }|d d}|dd} |d|d|d| d7}|d7}qtd|q |S)zE Gets fallback metrics from prometheus for the last 24 hours Z-litellm_deployment_successful_fallbacks_totalZ)litellm_deployment_failed_fallbacks_total)r Nzresponse json %sz result= %smetricvaluesrinstance primary_modelUnknownfallback_model`z3 successful fallback requests` with primary model=`z` -> fallback model=` zresponse message %s)r rrr rrfloat) Zresponse_messageZrelevant_metricsr"Z response_jsonrZ metric_valuesZmost_recent_valuevaluer&r(rrr#get_fallback_metric_from_prometheus+s4      r-returncCstdurdSdS)NTF)r rrrris_prometheus_connectedNsr/api_keycstdur tdt}|tdd}|d}|d}td}|dur,d}nd|d }|||d d }tj||d IdH}|} t d | |dd} g} | D]$} | d} | D]\}}t t |d}t |}| ||dqaqY| S)z Expected Response Format: [ { "date": "2024-08-18T00:00:00+00:00", "spend": 1.001818099998933 }, ...] Nr )daysz+00:00z/api/v1/query_rangez*sum(delta(litellm_spend_metric_total[1d]))z5sum(delta(litellm_spend_metric_total{hashed_api_key="z"}[1d]))Z86400)r startendsteprrrrr#)datespend)r rrutcnowr isoformatrrrrr fromtimestampr+append)r0end_dateZ start_dateZ start_strZend_strurlr rrrrZformatted_resultsrZ metric_data timestampr,r6r7rrrget_daily_spend_from_prometheusTs@       r?)__doc__rrrtypingrZlitellmrZlitellm._loggingrZ&litellm.llms.custom_httpx.http_handlerrrr str__annotations__r ZLoggingCallbackrr r-boolr/r?rrrrs$    #