o ưi,]@sUdZddlZddlZddlmZmZmZmZmZm Z m Z m Z m Z ddl Z ddlmZmZmZmZddlmZddlmZdZe eed<zddlmmZeeddZWn ey_Ynwddlm Z!dd lm"Z#dd lm$Z$m%Z%m&Z&m'Z'm(Z(dd lm)Z*dd l+m,Z,dd l-m.Z.ddl/m0Z0ddl1m2Z2ddl3m4Z4ddl5m6Z6m7Z7m8Z8m9Z9m:Z:de;de;fddZdS)zF LiteLLM Proxy uses this MCP Client to connnect to other MCP servers. N) Any AwaitableCallableDictListOptionalTupleTypeVarUnion) ClientSessionReadResourceResultResourceStdioServerParameters) sse_client) stdio_clientstreamable_http_client)CallToolRequestParams)CallToolResult)GetPromptRequestParamsGetPromptResultPromptResourceTemplate TextContent)Tool)AnyUrl)verbose_logger)MCP_CLIENT_TIMEOUT)get_ssl_configuration) VerifyTypes)MCPAuth MCPAuthTypeMCPStdioConfig MCPTransportMCPTransportType auth_valuereturncCst|dS)z(Convert auth value to Basic Auth format.zutf-8)base64 b64encodeencodedecode)r$r*]/home/app/Keep/.python/lib/python3.10/site-packages/litellm/experimental_mcp_client/client.py to_basic_auth-sr,TSessionResultc@seZdZdZdejddddddfdededede e ee eeffde e d e e d e e eefd e efd d Zdeee ejffddZdedeegeefdefddZdeegeefdefddZde ee eefffddZdefddZdedejffddZdee fdd Z! d1d!e"d"e ede#fd#d$Z$dee%fd%d&Z&d'e'de(fd(d)Z)de*e+fd*d+Z,de*e-fd,d-Z.d.e/de0fd/d0Z1dS)2 MCPClientz MCP Client supporting: SSE and HTTP transports Authentication via Bearer token, Basic Auth, or API Key Tool calling with error handling and result parsing N server_urltransport_type auth_typer$timeout stdio_config extra_headers ssl_verifyc CsR||_||_||_|dur|nt|_d|_||_||_||_|r'| |dSdSN) r0r1r2rr3_mcp_auth_valuer4r5r6update_auth_value) selfr0r1r2r$r3r4r5r6r*r*r+__init__=s zMCPClient.__init__r%cCsd}|jtjkr+|jstdt|jdd|jdg|jdid}t|dfS|jtjkrE| }| }t |j |j ||ddfStdurMtd | }| }td |||t|j d }t|j |d }||fS) z Create the appropriate transport context based on transport type. Returns: Tuple of (transport_context, http_client). http_client is only set for HTTP transport and needs cleanup. Nz,stdio_config is required for stdio transportcommandr/argsenv)r<r=r>)urlr3headershttpx_client_factoryzNstreamable_http_client is not available. Please install mcp with HTTP support.z.litellm headers for streamable_http_client: %s)r@r3)r? http_client)r1r"stdior4 ValueErrorrgetrZsse_get_auth_headers_create_httpx_client_factoryrr0r3r ImportErrorrdebughttpxTimeout)r:rBZ server_paramsr@rA transport_ctxr*r*r+_create_transport_contextTsN       z#MCPClient._create_transport_contextrL operationc s|IdH}z|d|d}}t||}|IdH}z]|IdH||IdHWz |dddIdHWntyS}ztd|WYd}~nd}~wwWz |dddIdHWSty{}ztd|WYd}~Sd}~wwz |dddIdHWwty}ztd|WYd}~wd}~wwz |dddIdHWwty}ztd|WYd}~wd}~ww)z Execute an operation within a transport and session context. Handles entering/exiting contexts and running the operation. Nrz#Error during session context exit: z%Error during transport context exit: ) __aenter__r Z initialize __aexit__ BaseExceptionrrI) r:rLrN transport read_streamZ write_streamZ session_ctxsessioner*r*r+_execute_session_operationsD  z$MCPClient._execute_session_operationcsd}zKz9|\}}|||IdHWW|dur=z |IdHWSty<}ztd|WYd}~Sd}~wwStyNtd|jpKdw|durwz |IdHWwtyv}ztd|WYd}~wd}~www)z9Open a session, run the provided coroutine, and clean up.Nz"Error during http_client cleanup: z)MCP client run_with_session failed for %srC) rMrWacloserRrrI Exceptionwarningr0)r:rNrBrLrVr*r*r+run_with_sessions6   zMCPClient.run_with_sessionmcp_auth_valuecCs2t|tr ||_dS|jtjkrt|}||_dS)zC Set the authentication header for the MCP client. N) isinstancedictr8r2rbasicr,)r:r\r*r*r+r9s    zMCPClient.update_auth_valuecCsi}|jr\t|jtrP|jtjkrd|j|d<nB|jtjkr)d|j|d<n3|jtjkr5|j|d<n'|jtjkrA|j|d<n|jtj krOd|j|d<n t|jt r\| |j|j re| |j |S)z3Generate authentication headers based on auth type.zBearer AuthorizationzBasic z X-API-Key) r8r]strr2rZ bearer_tokenr_Zapi_key authorizationZoauth2r^updater5)r:r@r*r*r+rFs&           zMCPClient._get_auth_headers.c sFdddddttttfdttjdttjdtjffdd}|S) a Create a custom httpx client factory that uses LiteLLM's SSL configuration. This factory follows the same CA bundle path logic as http_handler.py: 1. Check ssl_verify parameter (can be SSLContext, bool, or path to CA bundle) 2. Check SSL_VERIFY environment variable 3. Check SSL_CERT_FILE environment variable 4. Fall back to certifi CA bundle N)r@r3authr@r3rdr%cs4tj}tdt|jtj||||ddS)z=Create an httpx.AsyncClient with LiteLLM's SSL configuration.z$MCP client using SSL configuration: T)r@r3rdverifyZfollow_redirects)rr6rrItype__name__rJ AsyncClient)r@r3rdZ ssl_configr:r*r+factorys z7MCPClient._create_httpx_client_factory..factory)rrrarJrKZAuthrh)r:rjr*rir+rGs z&MCPClient._create_httpx_client_factoryc std|jpddtfdd}z*||IdH}t|j}dd|jD}td |d |jp3dd ||jWStj yKt d t y}z1t |j }td |dt|d|jpfdd|jd|vsvd|vr{tdgWYd}~Sd}~ww)z%List available tools from the server.MCP client listing tools from rCrUc|IdHSr7) list_toolsrUr*r*r+_list_tools_operation z3MCPClient.list_tools.._list_tools_operationNcSg|]}|jqSr*name).0Ztoolr*r*r+ z(MCPClient.list_tools..MCP client listed tools from : z#MCP client list_tools was cancelledz+MCP client list_tools failed - Error Type: , Error: , Server: , Transport: BrokenResourceErrorBroken|MCP client detected broken connection/stream during list_tools - the MCP server may have crashed, disconnected, or timed out)rrIr0r r[lenZtoolsinfoasyncioCancelledErrorrZrYrfrg exceptionrar1error)r:roresultZ tool_countZ tool_namesrV error_typer*r*r+rmH    zMCPClient.list_toolscall_tool_request_paramshost_progress_callbackc s\tdjdjdtdtdBdtdBffdd d tffd d }z||IdH}td jd |WStj yMt dt y}zUddl }| }td|t|j}td|dt|djd|jp|dd|j d|vsd|vrtdttd|dt|dgddWYd}~Sd}~ww)z# Call an MCP Tool. zMCP client calling tool '' with arguments: progresstotalNmessagec s|r ||dnd}tdjd|d|d|dd|pd rLz ||IdHWdStyK}ztd |WYd}~dSd}~wwdS) Ndrz MCP Tool 'z ' progress: /z (z.0fz%) - r/zFailed to forward to Host: )rrrsrYrZ)rrr percentagerV)rrr*r+ on_progress7s* z(MCPClient.call_tool..on_progressrUcs&td|jjjdIdHS)Nz'MCP client sending tool call to session)rs argumentsZprogress_callback)rrI call_toolrsrrn)rrr*r+_call_tool_operationEs  z1MCPClient.call_tool.._call_tool_operationzMCP client tool call '' completed successfullyz"MCP client tool call was cancelledrz MCP client tool call traceback: z*MCP client call_tool failed - Error Type: rzz, Tool: r{rCr|r}r~zkMCP client detected broken connection/stream - the MCP server may have crashed, disconnected, or timed out.textry)rfrT)contentZisError)rrrsrfloatrar r[rrrZrY traceback format_excrIrfrgrr0r1MCPCallToolResultr) r:rrrZ tool_resultrVr error_tracerr*)rrrr+r+sX$    zMCPClient.call_toolc td|jpddtfdd}z*||IdH}t|j}dd|jD}td |d |jp3dd ||jWStj yKt d t y}z1t |j }td |dt|d|jpfdd|jd|vsvd|vr{tdgWYd}~Sd}~ww)z'List available prompts from the server.rkrCrUcrlr7) list_promptsrnr*r*r+_list_prompts_operation|rpz7MCPClient.list_prompts.._list_prompts_operationNcSrqr*rr)rtpromptr*r*r+rurvz*MCPClient.list_prompts..rwrxryz%MCP client list_prompts was cancelledz-MCP client list_prompts failed - Error Type: rzr{r|r}r~r)rrIr0r r[rZpromptsrrrrZrYrfrgrrar1)r:rrZ prompt_countZ prompt_namesrVrr*r*r+rvrzMCPClient.list_promptsget_prompt_request_paramscstdjdjdtffdd }z||IdH}tdjd|WStjy:td t y}z>d dl }| }t d |t |j}td |d t|djd|jpidd|j d|vsyd|vr~tdd}~ww)z.Fetch a prompt definition from the MCP server.zMCP client fetching prompt 'rrUcs$td|jjjdIdHS)Nz0MCP client sending get_prompt request to session)rsr)rrI get_promptrsrrnrr*r+_get_prompt_operations   z3MCPClient.get_prompt.._get_prompt_operationNzMCP client get_prompt 'rz#MCP client get_prompt was cancelledrz!MCP client get_prompt traceback: z+MCP client get_prompt failed - Error Type: rzz , Prompt: r{rCr|r}r~z}MCP client detected broken connection/stream during get_prompt - the MCP server may have crashed, disconnected, or timed out.)rrrsrr r[rrrZrYrrrIrfrgrrar0r1)r:rrZget_prompt_resultrVrrrr*rr+rsN    zMCPClient.get_promptc r)z)List available resources from the server.z"MCP client listing resources from rCrUcrlr7)list_resourcesrnr*r*r+_list_resources_operationrpz;MCPClient.list_resources.._list_resources_operationNcSrqr*rr)rtresourcer*r*r+rurvz,MCPClient.list_resources..rwz resources from ryz'MCP client list_resources was cancelledz/MCP client list_resources failed - Error Type: rzr{r|r}r~zMCP client detected broken connection/stream during list_resources - the MCP server may have crashed, disconnected, or timed out)rrIr0r r[r resourcesrrrrZrYrfrgrrar1)r:rrZresource_countZresource_namesrVrr*r*r+rrzMCPClient.list_resourcesc r)z2List available resource templates from the server.z+MCP client listing resource templates from rCrUcrlr7)list_resource_templatesrnr*r*r+"_list_resource_templates_operationrpzMMCPClient.list_resource_templates.._list_resource_templates_operationNcSrqr*rr)rtZresourceTemplater*r*r+rusz5MCPClient.list_resource_templates..rwz resource templates from ryz0MCP client list_resource_templates was cancelledz8MCP client list_resource_templates failed - Error Type: rzr{r|r}r~zMCP client detected broken connection/stream during list_resource_templates - the MCP server may have crashed, disconnected, or timed out)rrIr0r r[rZresourceTemplatesrrrrZrYrfrgrrar1)r:rrZresource_template_countZresource_template_namesrVrr*r*r+rsL    z!MCPClient.list_resource_templatesr?cstdddtffdd }z||IdH}tdd|WStjy5td ty}}z=d dl}| }t d |t |j }t d |d t|dd|jpcdd|j d|vssd|vrxt dd}~ww)z,Fetch resource contents from the MCP server.zMCP client fetching resource ''rUcstd|IdHS)Nz3MCP client sending read_resource request to session)rrI read_resourcernr?r*r+_read_resource_operation&s z9MCPClient.read_resource.._read_resource_operationNzMCP client read_resource 'rz&MCP client read_resource was cancelledrz$MCP client read_resource traceback: z.MCP client read_resource failed - Error Type: rzz, Url: r{rCr|r}r~zMCP client detected broken connection/stream during read_resource - the MCP server may have crashed, disconnected, or timed out.)rrr r[rrrZrYrrrIrfrgrrar0r1)r:r?rZread_resource_resultrVrrrr*rr+r"sJ    zMCPClient.read_resourcer7)2rg __module__ __qualname____doc__r"httprar#r rr rrr!rr;rrrJrhrMrr rr-rWr[r9r^rFrGrMCPToolrmMCPCallToolRequestParamsrrrrrrrlistr rrrrr rr*r*r*r+r.5s~   6   #+ K( 2(*r.)?rrr&typingrrrrrrrr r rJZmcpr r r rZmcp.client.sserZmcp.client.stdiorr__annotations__Zmcp.client.streamable_httpclientZstreamable_httpZstreamable_http_modulegetattrrHZ mcp.typesrrrrrrrrrrrZpydanticrZlitellm._loggingrZlitellm.constantsrZ&litellm.llms.custom_httpx.http_handlerrZlitellm.types.llms.custom_httprZlitellm.types.mcprr r!r"r#rar,r-r.r*r*r*r+s8,