o ưi 0@s$ddlmZddlZddlZddlZddlmZmZmZddl m Z m Z ddl m Z ddlmZddlmZddlmZdd lmZmZdd lmZmZdd lmZdd lmZmZdd l m!Z!erhddl m"Z"dZ#dZ$GdddeZ%d'ddZ&d(ddZ'd)d!d"Z(d'd#d$Z)Gd%d&d&eZ*dS)*) annotationsN) TYPE_CHECKINGAnyOptional)Status StatusCode)override)verbose_logger)SpanAttributes)_utils) OpenTelemetryOpenTelemetryConfig)BaseLLMObsOTELAttributessafe_set_attribute) safe_dumps)WeaveOtelConfigWeaveSpanAttributes)StandardCallbackDynamicParams)Spanzhttps://trace.wandb.aiz/otel/v1/tracesc@s"eZdZdZeed ddZdS) WeaveLLMObsOTELAttributesz Weave-specific LLM observability OTEL attributes. Weave automatically maps attributes from multiple frameworks including GenAI, OpenInference, Langfuse, and others. span'Span'kwargsdict[str, Any]cCsp|dpg}|dp i}d|i}|d}|d}|dur$||d<|dur,||d<t|tjt|dS)zFSet input messages as span attributes using OpenInference conventions.messagesoptional_params functionstoolsN)getrOpenInferenceSpanAttributesZ INPUT_VALUEjsondumps)rrrrpromptrrr#\/home/app/Keep/.python/lib/python3.10/site-packages/litellm/integrations/weave/weave_otel.py set_messages*s  z&WeaveLLMObsOTELAttributes.set_messagesN)rrrr)__name__ __module__ __qualname____doc__ staticmethodrr%r#r#r#r$r"s rrrrr response_objrc Cs|dpi}|dp i}|dpd}|dpd}|d}|s1|r1|r/|d|}n|}|rA|dd}t|tjj||d }d uret|ttfrUt |}t|tj j|t|tj jd |rd } t |d rs| } nt |d rz|} | rt|tjt | d Sd Sd S)z Sets Weave-specific metadata attributes onto the OTEL span. Based on Weave's OTEL attribute mappings from: https://github.com/wandb/weave/blob/master/weave/trace_server/opentelemetry/constants.py litellm_paramsmetadatamodelcustom_llm_provider display_name/__ session_idNT model_dumpr)rreplacerrZ DISPLAY_NAMEvalue isinstancelistdictrZ THREAD_IDZIS_TURNhasattrr5rZ OUTPUT_VALUE) rrr+r,r-r.r0r1r4Z output_dictr#r#r$_set_weave_specific_attributes<s6      r<api_keystrreturncCs&d|}t|}d|S)z{ Get the authorization header for Weave OpenTelemetry. Weave uses Basic auth with format: api: zapi:zBasic )base64 b64encodeencodedecode)r=Z auth_string auth_headerr#r#r$_get_weave_authorization_headerjs  rErcCstd}td}td}|std|std|r6|ds&d|}|dt}td |n tt}td |t |d }d |d |}|tj d<|tj d<t |||ddS)a Retrieves the Weave OpenTelemetry configuration based on environment variables. Environment Variables: WANDB_API_KEY: Required. W&B API key for authentication. WANDB_PROJECT_ID: Required. Project ID in format /. WANDB_HOST: Optional. Custom Weave host URL. Defaults to cloud endpoint. Returns: WeaveOtelConfig: A Pydantic model containing Weave OTEL configuration. Raises: ValueError: If required environment variables are missing. Z WANDB_API_KEYZWANDB_PROJECT_IDZ WANDB_HOSTz>WANDB_API_KEY must be set for Weave OpenTelemetry integration.zaWANDB_PROJECT_ID must be set for Weave OpenTelemetry integration. Format: /httpzhttps://r2z%Using Weave OTEL endpoint from host: zUsing Weave cloud endpoint: r=zAuthorization=z ,project_id=ZOTEL_EXPORTER_OTLP_ENDPOINTZOTEL_EXPORTER_OTLP_HEADERSZ otlp_http)otlp_auth_headersendpoint project_idprotocol) osgetenv ValueError startswithrstripWEAVE_OTEL_ENDPOINTr debugWEAVE_BASE_URLrEenvironr)r=rJhostrIrDrHr#r#r$get_weave_otel_configus4       rVcCs"t|||tt|||ddS)z Sets OpenTelemetry span attributes for Weave observability. Uses the same attribute setting logic as other OTEL integrations for consistency. rrr+N)r set_attributesrr<rWr#r#r$set_weave_otel_attributessrYcsNeZdZdZ  ddfdd Zd d Z dd d ZddZdddZZ S)WeaveOtelLoggera Weave (W&B) OpenTelemetry Logger for LiteLLM. Sends LLM traces to Weave via the OpenTelemetry Protocol (OTLP). Environment Variables: WANDB_API_KEY: Required. Weights & Biases API key for authentication. WANDB_PROJECT_ID: Required. Project ID in format /. WANDB_HOST: Optional. Custom Weave host URL. Defaults to cloud endpoint. Usage: litellm.callbacks = ["weave_otel"] Or manually: from litellm.integrations.weave.weave_otel import WeaveOtelLogger weave_logger = WeaveOtelLogger(callback_name="weave_otel") litellm.callbacks = [weave_logger] Reference: https://docs.wandb.ai/weave/guides/tracking/otel N weave_otelconfigOptional[OpenTelemetryConfig] callback_name Optional[str]c s>|durt}t|j|j|jd}tjd||d|dS)z Initialize WeaveOtelLogger. If config is not provided, automatically configures from environment variables (WANDB_API_KEY, WANDB_PROJECT_ID, WANDB_HOST) via get_weave_otel_config(). N)ZexporterrIheaders)r\r^r#)rVr rKrIrHsuper__init__)selfr\r^rZ weave_config __class__r#r$rbs zWeaveOtelLogger.__init__cCsdS)z Override to skip creating the raw_gen_ai_request child span. For Weave, we only want a single span per LLM call. The parent span already contains all the necessary attributes, so the child span is redundant. Nr#)rcrr+ start_timeend_time parent_spanr#r#r$_maybe_log_raw_requestsz&WeaveOtelLogger._maybe_log_raw_requestc CsZ||}|j|||||d}|ttj|||||j ||d|S)z Override to always create a child span instead of reusing the parent span. This ensures that wrapper spans (like "B", "C", "D", "E") remain separate from the LiteLLM LLM call spans, creating proper nesting in Weave. )namerfcontext)rg) Zget_tracer_to_use_for_requestZ start_spanZ_get_span_nameZ_to_nsZ set_statusrrOKrXend) rcrr+rfrgrkrhZ otel_tracerrr#r#r$_start_primary_spans z#WeaveOtelLogger._start_primary_spanc Cstd||j||\}}d}|||||||}|||||||j||d||||||jjr@| |||dSdS)z Override to prevent ending externally created parent spans. When wrapper spans (like "B", "C", "D", "E") are provided as parent spans, they should be managed by the user code, not ended by LiteLLM. zGWeave OpenTelemetry Logger: Logging kwargs: %s, OTEL config settings=%sN)rrk) r rRr\Z_get_span_contextrnriZ_create_guardrail_spanZ_record_metricsZ enable_eventsZ_emit_semantic_logs) rcrr+rfrgctxrhZprimary_span_parentrr#r#r$_handle_success szWeaveOtelLogger._handle_success standard_callback_dynamic_paramsrr? dict | NonecCsFi}|d}|d}|rt|d}||d<|r||d<|r!|SdS)z Construct dynamic Weave headers from standard callback dynamic params. This is used for team/key based logging. Returns: dict: A dictionary of dynamic Weave headers Z wandb_api_keyZweave_project_idrG AuthorizationrJN)rrE)rcrqZdynamic_headersZdynamic_wandb_api_keyZdynamic_weave_project_idrDr#r#r$construct_dynamic_otel_headers0s   z.WeaveOtelLogger.construct_dynamic_otel_headers)Nr[)r\r]r^r_)N)rqrr?rr) r&r'r(r)rbrirnrprt __classcell__r#r#rdr$rZs 'rZ)rrrrr+r)r=r>r?r>)r?r)+ __future__rr@r rLtypingrrrZopentelemetry.tracerrZtyping_extensionsrZlitellm._loggingr Z*litellm.integrations._types.open_inferencer rZlitellm.integrations.arizer Z"litellm.integrations.opentelemetryr r ZElitellm.integrations.opentelemetry_utils.base_otel_llm_obs_attributesrrZ*litellm.litellm_core_utils.safe_json_dumpsrZ%litellm.types.integrations.weave_otelrrZlitellm.types.utilsrrrSrQrr<rErVrYrZr#r#r#r$s2          . 5