o ưig@sUdZddlZddlZddlZddlmZmZmZmZm Z m Z m Z ddl Z ddl mZmZddlmZddlmZddlmZddlmZdd lmZmZdd lmZdd lmZerkdd lm Z!dd l"m#Z#m$Z$m%Z%dZ&dZ'ee(d<dZ)ee(d<z dd lm Z)dZ&Wn e*yYnwddl+m,Z,ddl-m.Z.m/Z/ddl0m1Z1e,Z'de e2efde3de3ddfddZ4de e2efde e2ddfddZ5dede e2efde2fdd Z6d!d"d#e2d$e e2d%e e2efdef d&d'Z7ded!ed(ed)e e2d$e e2d*e e2defd+d,Z8e      dCde d-d!e d"d$e e2d%e e e2efde e2d.e e e2e2fdedefd/d0Z9edd-d!d"dede eeeeefffd1d2Z:d!d3d*e2de e2d%e e e2efd4e e e2efd5e e e2efdefd6d7Z;        dDde d-d!e d3d$e e2d%e e e2efde e2d4e e e2efd5e e e2efd.e e e2e2fdeefd8d9Z< : dEd;e2dd?Z>edfd;e2d||_||_||jd <||jd <|S) z Extract agent info and set model/custom_llm_provider for cost tracking. Sets model info on the litellm_logging_obj if available. Returns the agent name for logging. unknown_litellm_agent_cardN agent_cardname a2a_agent/ a2a_agentr!modelcustom_llm_provider)getattrr#r3r4r&)r,r agent_namer/r3r4r!r'r'r(_get_a2a_model_info`s      r7requestrr4api_baselitellm_paramscsptd|d|ddlm}t|jdr|jjddnt|j}|jt |j |||dId H}t |S) z Route a send_message through the LiteLLM completion bridge (e.g. LangGraph, Bedrock AgentCore). Requires request; api_base is optional for providers that derive endpoint from model. z&A2A using completion bridge: provider=z , api_base=rA2ACompletionBridgeHandler model_dumpjsonmodeZ request_idparamsr:r9N) r info6litellm.a2a_protocol.litellm_completion_bridge.handlerr<hasattrrBr=dictZhandle_non_streamingstridr from_dict)r8r4r9r:r<rB response_dictr'r'r(#_send_message_via_completion_bridges     rKr/card_urlr6c sd}tdD]w}z ||IdH}Wnjty5}zt|||dd}|r)|jnd}WYd}~qd}~wty~}z>z t||||dWn-tyl} zt| ||dd}|r[|jnd}WYd} ~ WYd}~qd} ~ wtyswWYd}~qd}~ww|durtd|S)z>Send an A2A message with retry logic for localhost URL errors.NFerrorr/r,Z is_streamingr3zCA2A send_message failed: no response received after retry attempts.)range send_messagerrurl Exceptionr RuntimeError) r,r8r/rLr9r6 a2a_response_e localhost_errr'r'r(_execute_a2a_send_with_retrysN   rZ A2AClientTypeagent_extra_headerscs|pi}|d}|rt|ddnd}|d} | r.|dur#tdt|| ||dIdHS|dur6td|durd|durBtd|pItt}d |i} |rT|| d <|r[| |t|| d IdH}|dusjJt ||} t d |j d | t|ddpt|dd} | rt| ddnd} |ptt}|j j}t|tr|ddur||d<n t|dddur||_t||| | || dIdH}t d|j t|}|jddd}tj||d\}}}t|||dt||d|S)as Async: Send a message to an A2A agent. Uses the @client decorator for LiteLLM logging and tracking. If litellm_params contains custom_llm_provider, routes through the completion bridge. Args: a2a_client: An initialized a2a.client.A2AClient instance (optional if using completion bridge) request: SendMessageRequest from a2a.types (optional if using completion bridge with api_base) api_base: API base URL (required for completion bridge, optional for standard A2A) litellm_params: Optional dict with custom_llm_provider, model, etc. for completion bridge agent_id: Optional agent ID for tracking in SpendLogs **kwargs: Additional arguments passed to the client decorator Returns: LiteLLMSendMessageResponse (wraps a2a SendMessageResponse with _hidden_params) Example (standard A2A): ```python from litellm.a2a_protocol import asend_message, create_a2a_client from a2a.types import SendMessageRequest, MessageSendParams from uuid import uuid4 a2a_client = await create_a2a_client(base_url="http://localhost:10001") request = SendMessageRequest( id=str(uuid4()), params=MessageSendParams( message={"role": "user", "parts": [{"kind": "text", "text": "Hello!"}], "messageId": uuid4().hex} ) ) response = await asend_message(a2a_client=a2a_client, request=request) ``` Example (completion bridge with LangGraph): ```python from litellm.a2a_protocol import asend_message from a2a.types import SendMessageRequest, MessageSendParams from uuid import uuid4 request = SendMessageRequest( id=str(uuid4()), params=MessageSendParams( message={"role": "user", "parts": [{"kind": "text", "text": "Hello!"}], "messageId": uuid4().hex} ) ) response = await asend_message( request=request, api_base="http://localhost:2024", litellm_params={"custom_llm_provider": "langgraph", "model": "agent"}, ) ``` r!Zlitellm_trace_idNr4)request is required for completion bridge)r8r4r9r:request is required?Either a2a_client or api_base is required for standard A2A flowX-LiteLLM-Trace-IdX-LiteLLM-Agent-Idbase_url extra_headerszA2A send_message request_id=z, agent=r.r/rS context_id)r,r8r/rLr9r6z'A2A send_message completed, request_id=r>T)r@Z exclude_none)r8rJ)rrr)rr*)r#r5 ValueErrorrKrGuuiduuid4updatecreate_a2a_clientr7r rCrHrBmessage isinstancerFrerZrZfrom_a2a_responser=r Z%calculate_usage_from_request_responser)r+)r,r8r9r:r*r\r logging_objZtrace_idr4rdr6r/rLrerkrVresponserJrrrWr'r'r( asend_messages>          rocKsZzt}Wn tyd}Ynw|dur td||d|Sttd||d|S)a Sync: Send a message to an A2A agent. Uses the @client decorator for LiteLLM logging and tracking. Args: a2a_client: An initialized a2a.client.A2AClient instance request: SendMessageRequest from a2a.types **kwargs: Additional arguments passed to the client decorator Returns: LiteLLMSendMessageResponse (wraps a2a SendMessageResponse with _hidden_params) N)r,r8r')asyncioget_running_looprUrorun)r,r8rloopr'r'r(rRos  rRrmetadataproxy_server_requestc Cstj}d|}t|dddgdd|t|jt|jd}||_d|_||jd <d|jd <|r6||jd <|r<|ni} |rD|| d <|rJ|| d <| |_ | |_ | |jd<|pXi|jd <|S)z0Build logging object for streaming A2A requests.r1userzstreaming-request)ZrolecontentFasend_message_streaming)r3messagesstreamZ call_type start_timeZlitellm_call_idZ function_idr2r3r4r*rtrur:) datetimenowrrGrHr3r4r&copyr:Zoptional_params) r8r6r*r:rtrur{r3rmZ_litellm_paramsr'r'r(_build_streaming_logging_objs6       rcCs|pi}|d}|rM|durtdtd|ddlm} t|jdr/|jjdd nt |j} | j t |j | ||d 2z 3dHW} | Vq@6dS|durUtd |dur~|duratd d t |j i} |rn|| d<|ru| |t|| dIdH}|dusJtd|j t|ddpt|dd} | rt| ddnd}| rt| ddnd}t||||||d}d}tdD]}||}t||||d}zd}|2z 3dHW} |rd}| Vq6WdSty}z |r|dkrt|| |dd}| r| jnd}nWYd}~qd}~wty`}zD|r[|dkr[z t||||dWtyR}zt|| |dd}| rA| jnd}WYd}~WYd}~qd}~wtyZwd}~wwdS)a Async: Send a streaming message to an A2A agent. If litellm_params contains custom_llm_provider, routes through the completion bridge. Args: a2a_client: An initialized a2a.client.A2AClient instance (optional if using completion bridge) request: SendStreamingMessageRequest from a2a.types api_base: API base URL (required for completion bridge) litellm_params: Optional dict with custom_llm_provider, model, etc. for completion bridge agent_id: Optional agent ID for tracking in SpendLogs metadata: Optional metadata dict (contains user_api_key, user_id, team_id, etc.) proxy_server_request: Optional proxy server request data Yields: SendStreamingMessageResponse chunks from the agent Example (completion bridge with LangGraph): ```python from litellm.a2a_protocol import asend_message_streaming from a2a.types import SendStreamingMessageRequest, MessageSendParams from uuid import uuid4 request = SendStreamingMessageRequest( id=str(uuid4()), params=MessageSendParams( message={"role": "user", "parts": [{"kind": "text", "text": "Hello!"}], "messageId": uuid4().hex} ) ) async for chunk in asend_message_streaming( request=request, api_base="http://localhost:2024", litellm_params={"custom_llm_provider": "langgraph", "model": "agent"}, ): print(chunk) ``` r4Nr]z0A2A streaming using completion bridge: provider=rr;r=r>r?rAr^r_r`rarbz&A2A send_message_streaming request_id=r.r/rSr0r-)r8r6r*r:rtruTrM)rzr8rmr6FrNrP)r#rfr rCrDr<rErBr=rFZhandle_streamingrGrHrirjr5rrQZsend_message_streamingr rrrSrTr)r,r8r9r:r*rtrur\r4r<rBchunkZstreaming_extra_headersr/rLr6rmZ first_chunkattemptrziteratorrXrYr'r'r(rxs/         rxN@rctimeoutrdc ststdtd|d|i}|rtt||d<ttj |d}|j }|r=|j |t dt|t||d}|IdH}td t|d rU|jnd t||d }||_td ||S)az Create an A2A client for the given agent URL. This resolves the agent card and returns a ready-to-use A2A client. The client can be reused for multiple requests. Args: base_url: The base URL of the A2A agent (e.g., "http://localhost:10001") timeout: Request timeout in seconds (default: 60.0) extra_headers: Optional additional headers to include in requests Returns: An initialized a2a.client.A2AClient instance Example: ```python from litellm.a2a_protocol import create_a2a_client, asend_message # Create client once client = await create_a2a_client(base_url="http://localhost:10001") # Reuse for multiple requests response1 = await asend_message(a2a_client=client, request=request1) response2 = await asend_message(a2a_client=client, request=request2) ``` \The 'a2a' package is required for A2A agent invocation. Install it with: pip install a2a-sdkzCreating A2A client for rZdisable_aiohttp_transportZ llm_providerrBz&A2A client created with extra_headers= httpx_clientrcNzResolved agent card: r0r-)rr/zA2A client created for )A2A_SDK_AVAILABLE ImportErrorr rCrGsorteditemsrrZ A2AProviderrheadersrir debuglistkeysrget_agent_cardrEr0rr.) rcrrdZ_client_paramsZ_async_handlerrresolverr/r,r'r'r(rjhsH   rjrcsttstdtd|ttjd|id}|j}t||d}| IdH}tdt |dr3|j nd |S) aF Fetch the agent card from an A2A agent. Args: base_url: The base URL of the A2A agent (e.g., "http://localhost:10001") timeout: Request timeout in seconds (default: 60.0) extra_headers: Optional additional headers to include in requests Returns: AgentCard from the A2A agent rzFetching agent card from rrrNzFetched agent card: r0r-) rrr rCrrZA2ArrrrEr0)rcrrdZ http_handlerrrr/r'r'r(aget_agent_cards(r)NNNNNN)NNNNNNNN)rN)@__doc__rpr|rgtypingrrrrrrrr$Zlitellm._loggingr r Z'litellm.a2a_protocol.streaming_iteratorr Zlitellm.a2a_protocol.utilsr Zlitellm.constantsr Z*litellm.litellm_core_utils.litellm_loggingrZ&litellm.llms.custom_httpx.http_handlerrrZlitellm.types.agentsrZ litellm.utilsrZ a2a.clientrr[Z a2a.typesrrrrr__annotations__rrZ"litellm.a2a_protocol.card_resolverrZ,litellm.a2a_protocol.exception_mapping_utilsrrZlitellm.a2a_protocol.exceptionsrrGintr)r+r7rKrZrorRrrxfloatrjrr'r'r'r(sZ$                 "  # +   + 2 \