o ưi+@sFddlZddlmZmZmZmZmZddlmZm Z GdddZ dS)N)ListDictAnyOptionalUnion)UnauthorizedError NotFoundErrorc@seZdZddedeefddZdeeeffddZdd ede e eee fe j ffd d Z  dd edeee fdeeee fd ede eee fe j ff ddZdded ede eee fe j ffddZ ddeed eed ede eee fe j ffddZdd ede e eee fe j ffddZ  ddedeee fdeeee fd ede eee fe j ff ddZdS)ModelsManagementClientNbase_urlapi_keycCs|d|_||_dS)a Initialize the ModelsManagementClient. Args: base_url (str): The base URL of the LiteLLM proxy server (e.g., "http://localhost:8000") api_key (Optional[str]): API key for authentication. If provided, it will be sent as a Bearer token. /N)rstrip _base_url_api_key)selfr r rR/home/app/Keep/.python/lib/python3.10/site-packages/litellm/proxy/client/models.py__init__s  zModelsManagementClient.__init__returncCsi}|jr d|j|d<|S)z Get the headers for API requests, including authorization if api_key is set. Returns: Dict[str, str]: Headers to use for API requests zBearer Authorization)r)rheadersrrr _get_headerssz#ModelsManagementClient._get_headersFreturn_requestc C|jd}tjd||d}|r|St}z||}||dWStj j yC}z |j j dkr>t |d}~ww)a Get the list of models supported by the server. Args: return_request (bool): If True, returns the prepared request object instead of executing it. Useful for inspection or modification before sending. Returns: Union[List[Dict[str, Any]], requests.Request]: Either a list of model information dictionaries or a prepared request object if return_request is True. Raises: UnauthorizedError: If the request fails with a 401 status code requests.exceptions.RequestException: If the request fails with any other error z/modelsGETrdataNrrequestsRequestrSessionsendprepareraise_for_statusjson exceptions HTTPErrorresponse status_coderrrurlrequestsessionr)errrlists  zModelsManagementClient.list model_name model_params model_infoc Cs|jd}||d}|r||d<tjd|||d}|r |St}z||} | | WStj j yM} z | j j dkrHt | d} ~ ww)a Add a new model to the proxy. Args: model_name (str): Name of the model to add model_params (Dict[str, Any]): Parameters for the model (e.g., model type, api_base, api_key) model_info (Optional[Dict[str, Any]]): Additional information about the model return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the response from the server or a prepared request object if return_request is True Raises: UnauthorizedError: If the request fails with a 401 status code requests.exceptions.RequestException: If the request fails with any other error z /model/new)r1litellm_paramsr3POSTrr&rNr) rr1r2r3rr,rr-r.r)r/rrrnew?s(   zModelsManagementClient.newmodel_idc Cs|jd}d|i}tjd|||d}|r|St}z||}||WStj j yX}z|j j dkrAt ||j j dksOd|j jvrSt|d}~ww) a Delete a model from the proxy. Args: model_id (str): ID of the model to delete (e.g., "2f23364f-4579-4d79-a43a-2d48dd551c2e") return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the response from the server or a prepared request object if return_request is True Raises: UnauthorizedError: If the request fails with a 401 status code NotFoundError: If the request fails with a 404 status code or indicates the model was not found requests.exceptions.RequestException: If the request fails with any other error z /model/deleteidr5r6r not foundNrr r!rr"r#r$r%r&r'r(r)r*rtextlowerr ) rr8rr,rr-r.r)r/rrrdeleteps$   zModelsManagementClient.deletecCs|dur|dus|dur|durtd|r&|jdd}t|tjs$J|S|}t|ts1J|D]}|rB|did|ksK|rO|d|krO|Sq3|rYd|d }n |rbd |d }nd }ttjj |t d ) aN Get information about a specific model by its ID or name. Args: model_id (Optional[str]): ID of the model to retrieve model_name (Optional[str]): Name of the model to retrieve return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the model information from the server or a prepared request object if return_request is True Raises: ValueError: If neither model_id nor model_name is provided, or if both are provided UnauthorizedError: If the request fails with a 401 status code NotFoundError: If the model is not found requests.exceptions.RequestException: If the request fails with any other error Nz6Exactly one of model_id or model_name must be providedT)rr3r9r1zModel with id=z not foundzModel with model_name=z"Unknown error trying to find model)r)) ValueErrorinfo isinstancer r!rgetr r'r(Response)rr8r1rresultmodelsmodelmsgrrrrCs4  zModelsManagementClient.getc Cr)a; Get detailed information about all models from the server. Args: return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[List[Dict[str, Any]], requests.Request]: Either a list of model information dictionaries or a prepared request object if return_request is True Raises: UnauthorizedError: If the request fails with a 401 status code requests.exceptions.RequestException: If the request fails with any other error z/v1/model/inforrrrNrr+rrrrAs  zModelsManagementClient.infoc Cs|jd}||d}|r||d<tjd|||d}|r |St}z||} | | WStj j y_} z| j j dkrHt | | j j dksVd| j jvrZt| d } ~ ww) aK Update an existing model's configuration. Args: model_id (str): ID of the model to update model_params (Dict[str, Any]): New parameters for the model (e.g., model type, api_base, api_key) model_info (Optional[Dict[str, Any]]): Additional information about the model return_request (bool): If True, returns the prepared request object instead of executing it Returns: Union[Dict[str, Any], requests.Request]: Either the response from the server or a prepared request object if return_request is True Raises: UnauthorizedError: If the request fails with a 401 status code NotFoundError: If the model is not found requests.exceptions.RequestException: If the request fails with any other error z /model/update)r9r4r3r5r6rr:r;Nr<) rr8r2r3rr,rr-r.r)r/rrrupdates,   zModelsManagementClient.update)N)F)NF)NNF)__name__ __module__ __qualname__strrrrrboolrrrr r!r0r7r?rCrArIrrrrr sT * %  *1' *7$ r ) r typingrrrrrr'rr r rrrrs