o ưiy@sddlZddlZddlmZmZmZmZmZddlZddl m Z ddl m Z ddl mZmZddlmZddlmZGd d d eZdS) N)Any CoroutineOptionalTupleUnion) LlmProviders)get_async_httpx_client)FileContentRequestHttpxBinaryResponseContent) SpecialEnums) BaseAWSLLMcseZdZdZfddZdedefddZdedeeeffd d Zd e d e d e e e jfdeedef ddZded e deed e d e e e jfdeede eeeeefffddZZS)BedrockFilesHandlerz Handles downloading files from S3 for Bedrock batch processing. This implementation downloads files from S3 buckets where Bedrock stores batch output files. cstttjd|_dS)N)Z llm_provider)super__init__rrZBEDROCKZasync_httpx_client)self __class__Y/home/app/Keep/.python/lib/python3.10/site-packages/litellm/llms/bedrock/files/handler.pyrs  zBedrockFilesHandler.__init__file_idreturncCsz.|dt| d}t|}|tjjr-d|vr-|dddd}|WSWn t y7Ynw|dr?|Sd|S)a Extract S3 URI from encoded file ID. The file ID can be in two formats: 1. Base64-encoded unified file ID containing: llm_output_file_id,s3://bucket/path 2. Direct S3 URI: s3://bucket/path Args: file_id: Encoded file ID or direct S3 URI Returns: S3 URI (e.g., "s3://bucket-name/path/to/file") =zllm_output_file_id,;rs3://) lenbase64urlsafe_b64decodedecode startswithr ZLITELM_MANAGED_FILE_ID_PREFIXvaluesplit Exception)rrpaddeddecodeds3_urirrr_extract_s3_uri_from_file_id s   z0BedrockFilesHandler._extract_s3_uri_from_file_idr'cCsV|ds td|d|dd}d|vr#|dd\}}||fS|}d}||fS) z Parse S3 URI to extract bucket name and object key. Args: s3_uri: S3 URI (e.g., "s3://bucket-name/path/to/file") Returns: Tuple of (bucket_name, object_key) rzInvalid S3 URI format: z0. Expected format: s3://bucket-name/path/to/fileN/r)r! ValueErrorr#)rr'path bucket_name object_keyrrr _parse_s3_uriDs  z!BedrockFilesHandler._parse_s3_urifile_content_requestoptional_paramstimeout max_retriesc s8ddl}ddlm}|d}|std||}||\} } |j|dd} |j|d|d |d | |d |d |d |d|dd } |j d| j | j | j | | d} z| j| | d}|d}Wnty}z td|dt|d}~wwtjd|dditjd|dd}t|dS)a Download file content from S3 bucket for Bedrock files. Args: file_content_request: Contains file_id (encoded or S3 URI) optional_params: Optional parameters containing AWS credentials timeout: Request timeout max_retries: Max retry attempts Returns: HttpxBinaryResponseContent: Binary content wrapped in compatible response format rN) Credentialsrz+file_id is required in file_content_requestr+)r2modelaws_access_key_idaws_secret_access_keyaws_session_tokenaws_session_nameaws_profile_name aws_role_nameaws_web_identity_tokenaws_sts_endpoint) r7r8r9aws_region_namer:r;r<r=r>Zs3)r7r8r9Z region_nameverify)ZBucketKeyZBodyz!Failed to download file from S3: z . Error: z content-typezapplication/octet-streamGET)methodurl) status_codecontentheadersrequest)response)boto3Zbotocore.credentialsr5getr,r(r0Z_get_aws_region_nameZget_credentialsclientZ access_keyZ secret_keytokenZ_get_ssl_verifyZ get_objectreadr$strhttpxResponseRequestr )rr1r2r3r4rKr5rr'r.r/r? credentialsZ s3_clientrJ file_contenteZ mock_responserrr afile_content\sX       z!BedrockFilesHandler.afile_content _is_asyncapi_basecCs.|r |j||||dSt|j||||dS)al Download file content from S3 bucket for Bedrock files. Supports both sync and async operations. Args: _is_async: Whether to run asynchronously file_content_request: Contains file_id (encoded or S3 URI) api_base: API base (unused for S3 operations) optional_params: Optional parameters containing AWS credentials timeout: Request timeout max_retries: Max retry attempts Returns: HttpxBinaryResponseContent or Coroutine: Binary content wrapped in compatible response format )r1r2r3r4)rWasynciorun)rrXr1rYr2r3r4rrrrUsz BedrockFilesHandler.file_content)__name__ __module__ __qualname____doc__rrPr(rr0r dictrfloatrQTimeoutrintr rWboolrrrU __classcell__rrrrrsB $  I r)rZrtypingrrrrrrQZlitellmrZ&litellm.llms.custom_httpx.http_handlerrZlitellm.types.llms.openair r Zlitellm.types.utilsr Z base_aws_llmr rrrrrs