o ưi#@sdZddlmZmZmZmZmZddlmZddl m Z ddl m Z ddl TddlmZddlmZmZdd lmZdd lmZeZejd d geegd eefdededefddZejddgeegd eefdedefddZejddgddefddZdS)z2 Unified /v1/messages endpoint - (Anthropic Spec) ) APIRouterDepends HTTPExceptionRequestResponse)verbose_proxy_logger)AnthropicExceptionMapping)ModifyResponseException)*)user_api_key_auth)ProxyBaseLLMRequestProcessingcreate_response)_read_request_body)TokenCountResponsez /v1/messagesz[beta] Anthropic `/v1/messages`)tags dependenciesfastapi_responserequestuser_api_key_dictcsddlm}m}m}m}m}m}m} m} m } m } t |dIdH} t | d}z<|j d7id|d|d|d d d |d |d |d|ddddd| d| d| d|d|d| IdH}|WSty}zi|j}|j|||dIdHddl}ddlm}|dt|ddd|jdg|jddddd | d!ddur| d!d"urˇfd#d$}t j||||d%}t|d&id'IdHWYd}~SWYd}~Sd}~wtyJ}zg|j||| dIdHtd(t|| d)ipi}|d*ipi}|d+d,p d,}t j|| d-d,|| dt |d.d,| t |d/ddd0 }t|}t!t |d|t |d1d2t |d3d2t |d4d5|d6d}~ww)8z Use `{PROXY_BASE_URL}/anthropic/v1/messages` instead - [Docs](https://docs.litellm.ai/docs/anthropic_completion). This was a BETA endpoint that calls 100+ LLMs in the anthropic format. r) general_settings llm_router proxy_configproxy_logging_obj user_api_baseuser_max_tokens user_modeluser_request_timeoutuser_temperatureversionrN)datarrrZ route_typeZanthropic_messagesrrrrZselect_data_generatormodelrrrrrr)rZoriginal_exception request_data)AnthropicMessagesResponseZmsg_messageZ assistanttext)typer%Zend_turn) input_tokensZ output_tokens)idr&Zrolecontentr!Z stop_reasonusagestreamTcs VdS)Nr,Z_anthropic_responser,b/home/app/Keep/.python/lib/python3.10/site-packages/litellm/proxy/anthropic_endpoints/endpoints.py_passthrough_stream_generatorbs z9anthropic_response.._passthrough_stream_generator)responserr"rztext/event-stream) generator media_typeheaderszGlitellm.proxy.proxy_server.anthropic_response(): Exception occured - {}litellm_metadata model_infor(Zlitellm_call_idZallowed_model_regiontimeout) rZcall_idmodel_idrZ response_costZ model_regionr"r7Zlitellm_logging_objr&Noneparam status_code)r$r&r:coder3r,)"litellm.proxy.proxy_serverrrrrrrrrrrrr Zbase_process_llm_requestr r"Zpost_call_failure_hookuuidlitellm.types.utilsr#struuid4r$r!getZasync_sse_data_generatorr Exceptionr exceptionformatZget_custom_headersgetattrProxyException)rrrrrrrrrrrrrr Zbase_llm_response_processorresulte_datar?r#r/Zselected_data_generatorr4r5r8r3 error_msgr,r-r.anthropic_responses0                      rMz/v1/messages/count_tokensz([beta] Anthropic Messages Token Countingc s|ddlm}zdt|dIdH}i|}|d}|dg}|s)tddd id |s3tddd id dd lm}||||d |dd}||ddIdH} i} t| tr\| } nt| t rc| } d| ddiWStyst y} z| j r| j rt| j nd} tj| | jd} t| | d d} ~ wty} ztdt| tdddt| id d} ~ ww)a Count tokens for Anthropic Messages API format. This endpoint follows the Anthropic Messages API token counting specification. It accepts the same parameters as the /v1/messages endpoint but returns token counts instead of generating a response. Example usage: ``` curl -X POST "http://localhost:4000/v1/messages/count_tokens?beta=true" -H "Content-Type: application/json" -H "Authorization: Bearer your-key" -d '{ "model": "claude-3-sonnet-20240229", "messages": [{"role": "user", "content": "Hello Claude!"}] }' ``` Returns: {"input_tokens": } r) token_counterrNr!messagesierrorzmodel parameter is required)r;detailzmessages parameter is required)TokenCountRequesttoolssystem)r!rOrSrTT)rZ call_endpointr'Z total_tokensr<)r;Z raw_messagezIlitellm.proxy.anthropic_endpoints.count_tokens(): Exception occurred - {}zInternal server error: )r>rNrrCrlitellm.proxy._typesrR isinstancerZ model_dumpdictrHr=isdigitintrZtransform_to_anthropic_errorr$rDrrErFrA)rrZinternal_token_counterr"r Z model_namerOrRZ token_requestZtoken_responseZ_token_response_dictrJr;rQr,r,r. count_tokenssp         rZz/api/event_logging/batchz[beta] Anthropic Event Logging)rcs ddiS)z Stubbed endpoint for Anthropic event logging batch requests. This endpoint accepts event logging requests but does nothing with them. It exists to prevent 404 errors from Claude Code clients that send telemetry. statusokr,rr,r,r.event_logging_batchs r]N)__doc__ZfastapirrrrrZlitellm._loggingrZ&litellm.anthropic_interface.exceptionsrZ%litellm.integrations.custom_guardrailr rUZ$litellm.proxy.auth.user_api_key_authr Z'litellm.proxy.common_request_processingr r Z-litellm.proxy.common_utils.http_parsing_utilsrr@rZrouterpostZUserAPIKeyAuthrMrZr]r,r,r,r.sV        [