o 0 i#@sddlmZddlZddlmZddlmZddlmZmZm Z ddl m Z ddl m Z mZddlmZdd lmZerJdd lmZmZdd lmZzddlZWn ey[e d wd dZddZddZddZGdddeZdS)) TYPE_CHECKINGN)consts)record_token_usage)get_start_span_functionset_data_normalizedtruncate_and_annotate_messages)SPANDATA) DidNotEnable Integration)should_send_default_pii)event_from_exception)AnyDict)datetimezLiteLLM not installedcCs.|di}|d}|duri}||d<|S)z,Get the metadata dictionary from the kwargs.litellm_paramsmetadataN) setdefaultget)kwargsrrrk/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/sentry_sdk/integrations/litellm.py_get_metadata_dicts  rcCstt}|dur dS|dd}z t|\}}}}Wn ty+|}d}Ynw|dd}|dkr9d}nd}t|dkrEt j j nt j j |d |tj d }||t|d <t|tj|t|tj||d g} | rtr|jrt} t| || } | durt|tj| d dtjtjtjtjtjtjtjd} | D]\} }|| }|durt|||q|d|d|dd}| D]\} }|durt|d| |qdS)zHandle the start of a request.Nmodelunknown call_typeZ embeddingZ embeddingsZchat )opnameorigin _sentry_spanmessagesF)unpack)rstreamZ max_tokensZpresence_penaltyZfrequency_penaltyZ temperatureZtop_papi_base api_versioncustom_llm_provider)r$r%r&zgen_ai.litellm.)! sentry_sdk get_clientget_integrationLiteLLMIntegrationrlitellmZget_llm_provider ExceptionrrOPZ GEN_AI_CHATZGEN_AI_EMBEDDINGSr __enter__rrrZ GEN_AI_SYSTEMZGEN_AI_OPERATION_NAMEr include_promptsZget_current_scoperZGEN_AI_REQUEST_MESSAGESZGEN_AI_REQUEST_MODELZGEN_AI_RESPONSE_STREAMINGZGEN_AI_REQUEST_MAX_TOKENSZGEN_AI_REQUEST_PRESENCE_PENALTYZ GEN_AI_REQUEST_FREQUENCY_PENALTYZGEN_AI_REQUEST_TEMPERATUREZGEN_AI_REQUEST_TOP_Pitems)r integrationZ full_modelrprovider_rZ operationspanr!scopeZ messages_dataparamskey attributevaluerrrr_input_callback'sn          r:c Cst|d}|dur dStt}|durdSzt|dr(t|tj |j t r|j rt|drg}|j D]P}t|drt|jdrN||jq8t|jdr]||jq8i}t|jdrk|jj|d<t|jd rw|jj|d <t|jd r|jj|d <||q8|rt|tj|t|d r|j} t|t| d dt| d dt| dddW|ddddSW|ddddS|dddw)zHandle successful completion.r Nrchoicesmessage model_dumpdictrolecontent tool_callsusageZ prompt_tokensZcompletion_tokens total_tokens)Z input_tokensZ output_tokensrC)rrr'r(r)r*hasattrrrZGEN_AI_RESPONSE_MODELrr r/r;r<appendr=r>r?r@rAZGEN_AI_RESPONSE_TEXTrBrgetattr__exit__) rZcompletion_response start_timeend_timer4r1Zresponse_messageschoicemsgrBrrr_success_callbacktsX                    " rLc Cstt|d}|dur dSz"t|tjdddd\}}tj||dW|t||ddS|t||dw)zHandle request failure.r Nr+F)typeZhandled)Zclient_optionsZ mechanism)hint) rrr r'r(optionsZ capture_eventrGrM)r exceptionrHrIr4eventrNrrr_failure_callbacks *rRc@s4eZdZdZdZdeZd ddZeddZd S) r*a" LiteLLM integration for Sentry. This integration automatically captures LiteLLM API calls and sends them to Sentry for monitoring and error tracking. It supports all 100+ LLM providers that LiteLLM supports, including OpenAI, Anthropic, Google, Cohere, and many others. Features: - Automatic exception capture for all LiteLLM calls - Token usage tracking across all providers - Provider detection and attribution - Input/output message capture (configurable) - Streaming response support - Cost tracking integration Usage: ```python import litellm import sentry_sdk # Initialize Sentry with the LiteLLM integration sentry_sdk.init( dsn="your-dsn", send_default_pii=True integrations=[ sentry_sdk.integrations.LiteLLMIntegration( include_prompts=True # Set to False to exclude message content ) ] ) # All LiteLLM calls will now be monitored response = litellm.completion( model="gpt-3.5-turbo", messages=[{"role": "user", "content": "Hello!"}] ) ``` Configuration: - include_prompts (bool): Whether to include prompts and responses in spans. Defaults to True. Set to False to exclude potentially sensitive data. r+zauto.ai.TcCs ||_dS)N)r/)selfr/rrr__init__s zLiteLLMIntegration.__init__cCsntjpgt_ttjvrtjttjpgt_ttjvr"tjttjp&gt_ttjvr5tjtdSdS)z(Set up LiteLLM callbacks for monitoring.N)r+Zinput_callbackr:rEZsuccess_callbackrLZfailure_callbackrRrrrr setup_onces        zLiteLLMIntegration.setup_onceN)T) __name__ __module__ __qualname____doc__ identifierrrT staticmethodrUrrrrr*s,  r*)typingrr'rZsentry_sdk.ai.monitoringrZsentry_sdk.ai.utilsrrrZsentry_sdk.constsrZsentry_sdk.integrationsr r Zsentry_sdk.scoper Zsentry_sdk.utilsr r rrr+ ImportErrorrr:rLrRr*rrrrs,          M<