o ưi@spddlmZmZmZmZmZmZddlZddlZddl m Z ddl m Z er-ddl mZneZGdddZdS)) TYPE_CHECKINGAnyDictOptionalTupleUnionN)get_async_httpx_client) LlmProviders)#GenerateContentContentListUnionDictc@seZdZdedefddZddedeedefdd Z    ddeed eed eeeefded eeeefde eeefeff ddZ   ddeded eedeedee e e jfdeeeff ddZdS)GoogleAIStudioTokenCountercontentsreturnc Cszddl}ddlm}|s|S||}|D]%}|d}|D]}d|vr9|d}|di|} d| _| jdd|d<qq|S) a{ Clean up contents to remove unsupported fields for the Gemini API. The Google Gemini API doesn't recognize the 'id' field in function responses, so we need to remove it to prevent 400 Bad Request errors. Args: contents: The contents to clean up Returns: Cleaned contents with unsupported fields removed rN)FunctionResponsepartsZfunctionResponseT)Z exclude_none)copyZgoogle.genai.typesrdeepcopyidZ model_dump) selfr rrcleaned_contentscontentrpartZfunction_response_dataZfunction_response_partrr_/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/gemini/count_tokens/handler.py_clean_contents_for_gemini_apis$    z9GoogleAIStudioTokenCounter._clean_contents_for_gemini_apiNmodelapi_basecCs|pd}|d|dS)zV Construct the URL for the Google Gen AI Studio countTokens endpoint. z)https://generativelanguage.googleapis.comz/v1beta/models/z :countTokensr)rrrbase_urlrrr_construct_url4sz)GoogleAIStudioTokenCounter._construct_urlapi_keyheaderslitellm_paramscs8ddlm}|j||||d}|j||d}||fS)zg Returns a Tuple of headers and url for the Google Gen AI Studio countTokens endpoint. r)GoogleGenAIConfig)rr rr!)rr)Z/litellm.llms.gemini.google_genai.transformationr"validate_environmentr)rrrr rr!r"urlrrrr#;s z/GoogleAIStudioTokenCounter.validate_environmenttimeoutc s|j||i||dIdH\}}||} d| i} ttjd} z| j||| dIdH} | | } | WStj yZ}zd|j j d|j j }t j|d||j j d |d}~wtjyv}zd t|}t j|d|d |d}~wty}z d t|}t||d}~ww) a Count tokens using Google Gen AI Studio countTokens endpoint. Args: contents: The content to count tokens for (Google Gen AI format) Example: [{"parts": [{"text": "Hello world"}]}] model: The model name (e.g. "gemini-1.5-flash") api_key: Optional Google API key (will fall back to environment) api_base: Optional API base URL (defaults to Google Gen AI Studio) timeout: Optional timeout for the request **kwargs: Additional parameters Returns: Dict containing token count information from Google Gen AI Studio API. Example response: { "totalTokens": 31, "totalBillableCharacters": 96, "promptTokensDetails": [ { "modality": "TEXT", "tokenCount": 31 } ] } Raises: ValueError: If API key is missing litellm.APIError: If the API call fails litellm.APIConnectionError: If the connection fails Exception: For any other unexpected errors )rrr rr!Nr ) llm_provider)r$r jsonz Google Gen AI Studio API error: z - gemini)messager&r status_codez(Request to Google Gen AI Studio failed: )r)r&rz(Unexpected error during token counting: )r#rrr ZGEMINIpostraise_for_statusr'httpxZHTTPStatusErrorresponser*textlitellmZAPIError RequestErrorstrZAPIConnectionError Exception)rr rrrr%kwargsr r$r request_bodyZasync_httpx_clientr.resulte error_msgrrr acount_tokensRsX+   z(GoogleAIStudioTokenCounter.acount_tokens)N)NNNrN)NNN)__name__ __module__ __qualname__rrr2rrrrr#rfloatr-Timeoutr9rrrrr sJ$   r )typingrrrrrrr-r0Z&litellm.llms.custom_httpx.http_handlerrZlitellm.types.utilsr Zlitellm.types.google_genai.mainr r rrrrs