o ưig{@sjdZddlZddlZddlmZmZmZmZddlm Z m Z m Z m Z m Z ddlZddlmZddlmZddlmZmZmZddlmZdd lmZdd lmZdd lmZmZm Z m!Z!m"Z"dd l#m$Z$dd l%m&Z&e Z'deddfddZ(e)ej*+ddZ,e)ej*+ddZ-de dee.effddZ/e'j+ddge egee de ddde efde d e0defd!d"Z1dd#l2m3Z4e'j5ddge ege de efdedefd$d%Z6e'j+d&dge ege de efd'e.defd(d)Z7e'j8d&dge ege de efd'e.dedefd*d+Z9e'j:d&dge ege de efd'e.de"defd,d-Z;e'je'j5d5dge egede efde!defd6d7Z?e'j+d8d9ge ege&ddddddd:d;de ef dee.d?ee.d@ee.dAe@dBe@dCee.defdDdEZAdS)Fz Agent endpoints for registering + discovering agents via LiteLLM. Follows the A2A Spec. 1. Register an agent via POST `/v1/agents` 2. Discover agents via GET `/v1/agents` 3. Get specific agent via GET `/v1/agents/{agent_id}` N)AnyDictListOptional) APIRouterDepends HTTPExceptionQueryRequest)verbose_proxy_logger)get_async_httpx_client)CommonProxyErrorsLitellmUserRolesUserAPIKeyAuthuser_api_key_auth)check_feature_access_for_user)get_daily_activity) AgentConfigAgentMakePublicResponse AgentResponseMakeAgentsPublicRequestPatchAgentRequest)httpxSpecialProvider)SpendAnalyticsPaginatedResponseuser_api_key_dictreturncCs(|jtjkrtddd|jiddS)z Raises HTTP 403 if the caller does not have permission to create, update, or delete agents. Only PROXY_ADMIN users are allowed to perform these write operations. errorzDOnly proxy admins can create, update, or delete agents. Your role={} status_codedetailN) user_roler PROXY_ADMINrformat)rr%^/home/app/Keep/.python/lib/python3.10/site-packages/litellm/proxy/agent_endpoints/endpoints.py"_check_agent_management_permission's r'Z"LITELLM_AGENT_HEALTH_CHECK_TIMEOUTz5.0Z)LITELLM_AGENT_HEALTH_CHECK_GATHER_TIMEOUTz30.0agentc s|jpid}|s|jddSz)ttjdtid}||IdH}|jdkr4|jdd |jd WS|jddWStyU}z|jdt |d WYd}~Sd}~ww) z Perform a GET request against the agent's URL and return the health result. Returns a dict with ``agent_id``, ``healthy`` (bool), and an optional ``error`` message. urlT)agent_idhealthytimeout)Z llm_providerparamsNFzHTTP r*r+r) agent_card_paramsgetr*r rZAgentHealthCheck"AGENT_HEALTH_CHECK_TIMEOUT_SECONDSr Exceptionstr)r(r)clientresponseexcr%r%r&_check_agent_url_health@s.    r8z /v1/agentsz[beta] A2A Agents)tags dependenciesZresponse_modelFzWhen true, performs a GET request to each agent's URL. Agents with reachable URLs (HTTP status < 500) and agents without a URL are returned; unreachable agents are filtered out.) descriptionrequest health_checkc s6t|dIdHddlm}ddlm}zg}|jtjks%|jtjjkr*| }n!|j |dIdHt dkr>| }n | }fdd|D}dd l m }|durd d|D}|r|jjjd d |iid IdH} dd| D} |D] } | j| vr| | j| _qv|D]} | jduri| _tjduo| jtjv| jd<q|rdd|D} dd|D} ztjtjdd| DtdIdH}Wntjytdtdd| D}Ynwdd|Dfdd| D| }|WStyty}ztd t!|tdddt!|idd}~ww)a Example usage: ``` curl -X GET "http://localhost:4000/v1/agents" -H "Content-Type: application/json" -H "Authorization: Bearer your-key" ``` Pass `?health_check=true` to filter out agents whose URL is unreachable: ``` curl -X GET "http://localhost:4000/v1/agents?health_check=true" -H "Content-Type: application/json" -H "Authorization: Bearer your-key" ``` Returns: List[AgentResponse] agentsNrglobal_agent_registry)AgentRequestHandlerrcg|] }|jvr|qSr%r*.0r()allowed_agent_idsr%r& szget_agents.. prisma_clientcSsg|]}|jqSr%rCrDr%r%r&rGsr*inwherecSsi|]}|j|jqSr%)r*spend)rEar%r%r& szget_agents..Z is_publiccSs g|] }|jpidr|qSr)r0r1rDr%r%r&rG cSs g|] }|jpids|qSrPrQrDr%r%r&rGrRcSsg|]}t|qSr%)r8rDr%r%r&rGs)r,z4Agent health check gather timed out after %s secondscSsg|] }|jdddqS)FzHealth check timed outr/rCrDr%r%r&rGs cSsh|] }|dr|dqS)r+r*r%)rEresultr%r%r& s zget_agents..crBr%rCrD) healthy_idsr%r&rGs  zClitellm.proxy.agent_endpoints.get_agents(): Exception occurred - {}r.rzInternal server error: r)"r,litellm.proxy.agent_endpoints.agent_registryr@Z;litellm.proxy.agent_endpoints.auth.agent_permission_handlerrAr"rr#valueZget_agent_listZget_allowed_agentslenlitellm.proxy.proxy_serverrIdblitellm_agentstable find_manyr*rMZlitellm_paramslitellmpublic_agent_groupsasynciowait_forgather)AGENT_HEALTH_CHECK_GATHER_TIMEOUT_SECONDS TimeoutErrorr warningrr3 exceptionr$r4)r<r=rr@rAZreturned_agentsZ all_agentsrI agent_idsZ db_agentsZ spend_mapr(Zagents_with_urlZagents_without_urlZhealth_resultser%)rFrUr& get_agentsbs                     rhr?c sTt|dIdHddlm}t||durtdddzi|jp"d}tj|d d }|dur=td d |d d dtj |||dIdH}|j }|j }ztj |dt d|d|dW|WSty}zt d|d|d|WYd}~|WSd}~wwtyty} zt d| tdt| dd} ~ ww)a: Create a new agent Example Request: ```bash curl -X POST "http://localhost:4000/agents" \ -H "Authorization: Bearer " \ -H "Content-Type: application/json" \ -d '{ "agent": { "agent_name": "my-custom-agent", "agent_card_params": { "protocolVersion": "1.0", "name": "Hello World Agent", "description": "Just a hello world agent", "url": "http://localhost:9999/", "version": "1.0.0", "defaultInputModes": ["text"], "defaultOutputModes": ["text"], "capabilities": { "streaming": true }, "skills": [ { "id": "hello_world", "name": "Returns hello world", "description": "just returns hello world", "tags": ["hello world"], "examples": ["hi", "hello world"] } ] }, "litellm_params": { "make_public": true } } }' ``` r>NrrHr.Prisma client not initializedrunknown agent_namerkAgent with name z already exists)r(rI created_byZ agent_configzSuccessfully registered agent '' (ID: ) in memoryzFailed to register agent 'z ) in memory: zError adding agent to db: )rrYrIr'ruser_idAGENT_REGISTRYZget_agent_by_namer1Zadd_agent_to_dbrkr*register_agentr infor3rdrer4) r<rrIroexisting_agentrSrkr*Z reg_errorrgr%r%r& create_agentsR1      rxz/v1/agents/{agent_id}r*c sXt|dIdHddlm}|durtdddzotj|d}|durc|jjjd |id d id IdH}|durb| }|j dur[z |j |d <Wnt yZ|j |d <Ynwt di|}n|jjjd |id IdH}|durx|j|_|durtdd|dd|WStyt y}ztd|tdt|dd}~ww)z Get a specific agent by ID Example Request: ```bash curl -X GET "http://localhost:4000/agents/123e4567-e89b-12d3-a456-426614174000" \ -H "Authorization: Bearer " ``` r>NrrHr.rirrCr*object_permissionT)rLincluderKAgent with ID not foundzError getting agent from db: r%)rrYrIrrtget_agent_by_idrZr[ find_unique model_dumpryr3dictrrMr rer4)r*rrIr(Z agent_rowZ agent_dictZdb_rowrgr%r%r&r~VsR          r~c 0t|dIdHddlm}t||durtdtjjdzU|jj j d|idIdH}|dur5t |}|durCtd d |d d|j pGd }t j||||d IdH}t j|ddt j|dtd|dd|d|WSty|ty}ztd|tdt|dd}~wwa Update an existing agent Example Request: ```bash curl -X PUT "http://localhost:4000/agents/123e4567-e89b-12d3-a456-426614174000" \ -H "Authorization: Bearer " \ -H "Content-Type: application/json" \ -d '{ "agent": { "agent_name": "updated-agent", "agent_card_params": { "protocolVersion": "1.0", "name": "Updated Agent", "description": "Updated description", "url": "http://localhost:9999/", "version": "1.1.0", "defaultInputModes": ["text"], "defaultOutputModes": ["text"], "capabilities": { "streaming": true }, "skills": [] }, "litellm_params": { "make_public": false } } }' ``` r>NrrHr.rr*rKr{r|r}rj)r*r(rI updated_byrkrlrpzSuccessfully updated agent 'rqrrzError updating agent: )rrYrIr'rr db_not_connected_errorrWrZr[rrrsrtZupdate_agent_in_dbderegister_agentr1rur rvr3rer4r*r<rrIrwrrSrgr%r%r& update_agentL*       rc rr)rrYrIr'rr rrWrZr[rrrsrtZpatch_agent_in_dbrr1rur rvr3rer4rr%r%r& patch_agentrrZAgents)r9r:c st|dIdHddlm}t||durtdddzC|jjjd|id IdH}|dur7tt t f|}|durEtd d |d dt j ||d IdHt j | dddd|diWStyhty}ztd|tdt|dd}~ww)aZ Delete an agent Example Request: ```bash curl -X DELETE "http://localhost:4000/agents/123e4567-e89b-12d3-a456-426614174000" \ -H "Authorization: Bearer " ``` Example Response: ```json { "message": "Agent 123e4567-e89b-12d3-a456-426614174000 deleted successfully" } ``` r>NrrHr.rirr*rKr{r|z not found in DB.)r*rIrkrlmessagezAgent z deleted successfullyzError deleting agent: )rrYrIr'rrZr[rrrrtZdelete_agent_from_dbrr1r3r rer4)r*rrIrwrgr%r%r& delete_agentRs8      rz!/v1/agents/{agent_id}/make_publicc sddlm}|durtdtjjdzddl}ddlm}ddlm }|j t j kr6tdd d |j id|j|d }|durh|jjjd |id IdH}|durZtdi|}|durhtdd|dd|jdurpg|_|j|jvrtdd|jdd|j|j|IdH}d|vs|dduri|d<|j|dd<|j|dIdHtd|jd|jd|j|jdWStyty}ztd|tdt|dd}~ww)a Make an agent publicly discoverable Example Request: ```bash curl -X POST "http://localhost:4000/v1/agents/123e4567-e89b-12d3-a456-426614174000/make_public" \ -H "Authorization: Bearer " \ -H "Content-Type: application/json" ``` Example Response: ```json { "agent_id": "123e4567-e89b-12d3-a456-426614174000", "agent_name": "my-custom-agent", "litellm_params": { "make_public": true }, "agent_card_params": {...}, "created_at": "2025-11-15T10:30:00Z", "updated_at": "2025-11-15T10:35:00Z", "created_by": "user123", "updated_by": "user123" } ``` rrHNr.rr? proxy_configrr>Only proxy admins can update public model groups. Your role={}rCr*rKr{r|r}rmrnz already in public agent groupslitellm_settingsr^Z new_config Updated public agent groups to: by user: (Successfully updated public agent groupsrr^rError making agent public: r%) rYrIrr rrWr]rVr@rr"rr#r$r~rZr[rrrr^r*rkappend get_config save_configr debugrsr3rer4) r*rrIr]rtrr(configrgr%r%r&make_agent_publicsp $          rz/v1/agents/make_publicc sddlm}|durtdtjjdzddl}ddlm}ddlm }| IdH}|j t j kr=tdd d |j id|jdurEg|_|jD]4}|j|d }|dur||jjjd |id IdH}|durntdi|}|dur|tdd|ddqH|j|_d|vs|dduri|d<|j|dd<|j|dIdHtd|jd|jd|j|jdWStyty} ztd| tdt| dd} ~ ww)a( Make multiple agents publicly discoverable Example Request: ```bash curl -X POST "http://localhost:4000/v1/agents/make_public" \ -H "Authorization: Bearer " \ -H "Content-Type: application/json" \ -d '{ "agent_ids": ["123e4567-e89b-12d3-a456-426614174000", "123e4567-e89b-12d3-a456-426614174001"] }' ``` Example Response: ```json { "agent_id": "123e4567-e89b-12d3-a456-426614174000", "agent_name": "my-custom-agent", "litellm_params": { "make_public": true }, "agent_card_params": {...}, "created_at": "2025-11-15T10:30:00Z", "updated_at": "2025-11-15T10:35:00Z", "created_by": "user123", "updated_by": "user123" } ``` rrHNr.rr?rrrrrCr*rKr{r|r}rr^rrrrrrr%)rYrIrr rrWr]rVr@rrr"rr#r$r^rfr~rZr[rrrrr rrsr3rer4) r<rrIr]rtrrr*r(rgr%r%r&make_agents_publicsj '         rz/agent/daily/activityzAgent Management rf start_dateend_datemodelapi_keypage page_sizeexclude_agent_idsc st|dIdHddlm} | durtddtjjid|r$|dnd} d} |r3|r1|dnd} i} | r?d t| i| d <| j j j | d IdH} d d | D}t | dd | || ||||||d IdHS)zJ Get daily activity for specific agents or all accessible agents. r>NrrHr.rr,rJr*rKcSsi|] }|jd|jiqSrl)r*rkrDr%r%r&rOsz,get_agent_daily_activity..Zlitellm_dailyagentspend) rIZ table_nameZentity_id_fieldZ entity_idZentity_metadata_fieldZexclude_entity_idsrrrrrr) rrYrIrr rrWsplitlistrZr[r\r)rfrrrrrrrrrIZagent_ids_listZexclude_agent_ids_listZwhere_conditionZ agent_recordsZagent_metadatar%r%r&get_agent_daily_activityosH    r)B__doc__r_ostypingrrrrZfastapirrrr r r]Zlitellm._loggingr Z&litellm.llms.custom_httpx.http_handlerr Zlitellm.proxy._typesr rrZ$litellm.proxy.auth.user_api_key_authrZ%litellm.proxy.common_utils.rbac_utilsrZ8litellm.proxy.management_endpoints.common_daily_activityrZlitellm.types.agentsrrrrrZlitellm.types.llms.custom_httprZ>litellm.types.proxy.management_endpoints.common_daily_activityrZrouterr'floatenvironr1r2rbr4r8boolrhrVr@rtpostrxr~putrpatchrdeleterrrintrr%r%r%r&sR            "   ] <  W  W 8 k i