o ưis2 @sddlmZmZddlmZmZmZmZddlm Z ddl Tddl m Z m Z ddlmZddlmZddlmZmZmZeZejd ee ge d gd ejd ee ge d gd ee fd edede fddZejd ee ge d gd ejd ee ge d gd ee fd edede fddZejdee ge d gd ejdee ge d gd ee fd ededede fddZejdee ge d gd ejdee ge d gd ee fd ededede fddZddlm Z e edS))AnyDict) APIRouterDependsRequestResponse)ORJSONResponse)*)UserAPIKeyAuthuser_api_key_auth)ProxyBaseLLMRequestProcessing)_read_request_body))get_custom_llm_provider_from_request_body,get_custom_llm_provider_from_request_headers*get_custom_llm_provider_from_request_queryz/v1/containers containers) dependenciesresponse_classtagsz /containersrequestfastapi_responseuser_api_key_dictc s&ddlm}m}m}m}m}m}m} m} m } m } m } t |dIdH}t |dp6t|dp6t|dIdHp6d}||d<t|d}z:|jdid|d |d |d d d |d|d|d|d|ddd| d| d| d| d|d| IdHWSty}z |j|||| dIdHd}~ww)aH Container creation endpoint for creating new containers. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X POST "http://localhost:4000/v1/containers" -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" -d '{ "name": "My Container", "expires_after": { "anchor": "last_active_at", "minutes": 20 } }' ``` Or specify provider via header: ```bash curl -X POST "http://localhost:4000/v1/containers" -H "Authorization: Bearer sk-1234" -H "custom-llm-provider: azure" -H "Content-Type: application/json" -d '{ "name": "My Container" }' ``` r general_settings llm_router proxy_configproxy_logging_objselect_data_generator user_api_baseuser_max_tokens user_modeluser_request_timeoutuser_temperatureversionrNopenaicustom_llm_providerdatarrr route_typeZacreate_containerrrrrrmodelr r"r!rrr#errr#)litellm.proxy.proxy_serverrrrrrrrr r!r"r#r rrrr base_process_llm_request Exception_handle_llm_api_exception)rrrrrrrrrrr r!r"r#r(r& processorr,r-r-b/home/app/Keep/.python/lib/python3.10/site-packages/litellm/proxy/container_endpoints/endpoints.pycreate_containersn40          r4c sddlm}m}m}m}m}m}m} m} m } m } m } t |j }d|i}t|dp/t|dp/d}||d<t|d}z:|jdid|d |d |d d d |d|d|d|d|ddd| d| d| d| d|d| IdHWSty}z |j|||| dIdHd}~ww)a Container list endpoint for retrieving a list of containers. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X GET "http://localhost:4000/v1/containers?limit=20&order=desc" -H "Authorization: Bearer sk-1234" ``` Or specify provider via header or query param: ```bash curl -X GET "http://localhost:4000/v1/containers?custom_llm_provider=azure" -H "Authorization: Bearer sk-1234" ``` rr query_paramsr$r%r&r'rrrr)Zalist_containersrrrrrr*Nr r"r!rrr#r+r-)r.rrrrrrrr r!r"r#dictr5rrr r/r0r1)rrrrrrrrrrr r!r"r#r5r(r&r2r,r-r-r3list_containerssl4#           r7z/v1/containers/{container_id}z/containers/{container_id} container_idc ddlm}m}m}m}m}m} m} m} m } m } m }d|i}t |dp*t |dp*d}||d<t|d}z:|jdid|d |d |d d d |d|d|d|d|ddd| d| d| d| d| d|IdHWSty}z |j||||dIdHd}~ww)a  Container retrieve endpoint for getting details of a specific container. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X GET "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" ``` Or specify provider via header: ```bash curl -X GET "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" -H "custom-llm-provider: azure" ``` rrr8r$r%r&r'rrrr)Zaretrieve_containerrrrrrr*Nr r"r!rrr#r+r-r.rrrrrrrr r!r"r#rrr r/r0r1rr8rrrrrrrrrr r!r"r#r(r&r2r,r-r-r3retrieve_containerj4%          r<c r9)a Container delete endpoint for deleting a specific container. Follows the OpenAI Containers API spec: https://platform.openai.com/docs/api-reference/containers Example: ```bash curl -X DELETE "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" ``` Or specify provider via header: ```bash curl -X DELETE "http://localhost:4000/v1/containers/cntr_123" -H "Authorization: Bearer sk-1234" -H "custom-llm-provider: azure" ``` rrr8r$r%r&r'rrrr)Zadelete_containerrrrrrr*Nr r"r!rrr#r+r-r:r;r-r-r3delete_container;r=r>)!register_container_file_endpointsN)!typingrrZfastapirrrrZfastapi.responsesrZlitellm.proxy._typesZ$litellm.proxy.auth.user_api_key_authr r Z'litellm.proxy.common_request_processingr Z-litellm.proxy.common_utils.http_parsing_utilsr Z0litellm.proxy.common_utils.openai_endpoint_utilsrrrZrouterpostr4getr7strr<deleter>Z1litellm.proxy.container_endpoints.handler_factoryr?r-r-r-r3s    _ Q R  S