o ưi^@ @sddlmZddlmZmZmZmZmZddlmZm Z ddl Z ddl m Z ddl TddlmZmZddlmZdd lmZdd lmZed gd Zejd eegdejdeegdeefdedededefddZejdeegdejdeegdeefdedededefddZejdeegedejdeegeddedefddZejdeeged gd!ejd"eeged gd!eefdededefd#d$Zejd%eeged gd!ejd&eeged gd!eefded'ededefd(d)Zej d%eeged gd!ej d&eeged gd!eefded'ededefd*d+Z!ejd,eeged gd!ejd-eeged gd!eefded'ededefd.d/Z"dS)0)datetime) APIRouterDepends HTTPExceptionRequestResponse)ORJSONResponseStreamingResponseN)uuid)*)UserAPIKeyAuthuser_api_key_auth)ProxyBaseLLMRequestProcessing_read_request_body)TokenCountDetailsResponsezgoogle genai endpoints)tagsz0/v1beta/models/{model_name:path}:generateContent) dependenciesz)/models/{model_name:path}:generateContentrequest model_namefastapi_responseuser_api_key_dictc sddlm}ddlm}m}m}m}t|dIdH} d| vr#|| d<| dd} | r/| | d<|| |||||dIdH} |j d t t | d <tjjdd tjtd | \} } | | d <|durktddd|jdi| IdH} | S)Nradd_litellm_data_to_requestgeneral_settings llm_router proxy_configversionrmodelgenerationConfigconfigdatarrrrrx-litellm-call-idlitellm_call_idagenerate_contentZoriginal_functionZ rules_obj start_timelitellm_logging_objRouter not initialized status_codedetail)$litellm.proxy.litellm_pre_call_utilsrlitellm.proxy.proxy_serverrrrrrpopheadersgetstrr uuid4litellmutilsfunction_setupRulesrnowrr' rrrrrrrrrr$Zgeneration_configZ logging_objresponser0r0_/home/app/Keep/.python/lib/python3.10/site-packages/litellm/proxy/google_endpoints/endpoints.pygoogle_generate_contents@      r@z6/v1beta/models/{model_name:path}:streamGenerateContentz//models/{model_name:path}:streamGenerateContentc sddlm}ddlm}m}m}m}t|dIdH} d| vr#|| d<d| d<| dd} | r3| | d <|| |||||d IdH} |j d t t | d <tjjdd tjtd| \} } | | d<|durotddd|jdi| IdH} | durt| drt| ddS| S)Nrrrrr Tstreamr!r"r#r%r&agenerate_content_streamr(r*r+r,r- __aiter__ztext/event-stream)content media_typer0)r1rr2rrrrrr3r4r5r6r r7r8r9r:r;rr<rrBhasattrr r=r0r0r?google_stream_generate_contentOsF       rGz,/v1beta/models/{model_name:path}:countTokens)rZresponse_modelz%/models/{model_name:path}:countTokensc sddlm}ddlm}ddlm}||dIdH}|dg}ddlm}| ||d g}||||d } || d d IdH} | durd| j pJi} | r[t | d d| dgdSt | j p`dgdSt dgdS)z ```json return { "totalTokens": 31, "totalBillableCharacters": 96, "promptTokensDetails": [ { "modality": "TEXT", "tokenCount": 31 } ] } ``` r)GoogleGenAIAdapterr) token_counterrNcontents)TokenCountRequestmessages)r rJrLT)rZ call_endpoint totalTokenspromptTokensDetails)rMrN) Z,litellm.google_genai.adapters.transformationrH-litellm.proxy.common_utils.http_parsing_utilsrr2rIr5litellm.proxy._typesrKZ(translate_generate_content_to_completionoriginal_responserZ total_tokens) rrrHrZinternal_token_counterr$rJrKrLZ token_requestZtoken_responserQr0r0r?google_count_tokenssF         rRz/v1beta/interactionsZ interactions)rresponse_classrz /interactionsc sHddlm}m}m}m}m}m}m} m} m } m } m } t |dIdH}d|vr+d|d<t |d}z[|jdid|d |d |d d d |d|d|d|d|d|dps|dd| d| d| d| d|d| IdHWSd| d| d| d| d|d| IdHWSty}z |j|||| dIdHd}~ww)a Create a new interaction using Google's Interactions API. Per OpenAPI spec: POST /{api_version}/interactions Supports both model interactions and agent interactions: - Model: Provide `model` parameter (e.g., "gemini-2.5-flash") - Agent: Provide `agent` parameter (e.g., "deep-research-pro-preview-12-2025") Example: ```bash curl -X POST "http://localhost:4000/v1beta/interactions" -H "Authorization: Bearer sk-1234" -H "Content-Type: application/json" -d '{ "model": "gemini/gemini-2.5-flash", "input": "Hello, how are you?" }' ``` r rrrproxy_logging_objselect_data_generator user_api_baseuser_max_tokens user_modeluser_request_timeoutuser_temperaturerrNcustom_llm_providergeminir$rrr route_typeZacreate_interactionrUrrrrVr ZagentrYr[rZrXrWrerrUrr0)r2rrrrUrVrWrXrYrZr[rrrbase_process_llm_requestr5 Exception_handle_llm_api_exception)rrrrrrrUrVrWrXrYrZr[rr$ processorrar0r0r?create_interactions~4%              rfz%/v1beta/interactions/{interaction_id}z/interactions/{interaction_id}interaction_idc ddlm}m}m}m}m}m} m} m} m } m } m }|dd}t |d}z:|j did|d|d|d d d |d |d |d|d|ddd| d| d| d| d| d|IdHWStyw}z |j||||dIdHd}~ww)zk Get an interaction by ID. Per OpenAPI spec: GET /{api_version}/interactions/{interaction_id} rrTr]rgr\r^rrrr_Zaget_interactionrUrrrrVr NrYr[rZrXrWrr`r0r2rrrrUrVrWrXrYrZr[rrrbrcrdrrgrrrrrrUrVrWrXrYrZr[rr$rerar0r0r?get_interaction9^4          rlc rh)zq Delete an interaction by ID. Per OpenAPI spec: DELETE /{api_version}/interactions/{interaction_id} rrTr]rir^rrrr_Zadelete_interactionrUrrrrVr NrYr[rZrXrWrr`r0rjrkr0r0r?delete_interaction}rmrnz,/v1beta/interactions/{interaction_id}/cancelz%/interactions/{interaction_id}/cancelc rh)zv Cancel an interaction by ID. Per OpenAPI spec: POST /{api_version}/interactions/{interaction_id}:cancel rrTr]rir^rrrr_Zacancel_interactionrUrrrrVr NrYr[rZrXrWrr`r0rjrkr0r0r?cancel_interactionrmro)#rZfastapirrrrrZfastapi.responsesrr r8Z litellm._uuidr rPZ$litellm.proxy.auth.user_api_key_authr r Z'litellm.proxy.common_request_processingrrOrZlitellm.types.llms.vertex_airZrouterpostr6r@rGrRrfr5rldeleternror0r0r0r?s$     4;G J 8 8