o ưi@sdZddlmZddlmZmZmZmZmZm Z m Z ddl Z ddl m Z ddlmZddlmZer>ddl mZddlmZGd d d e ZdS) z OpenAI-specific RAG Ingestion implementation. OpenAI handles embedding internally when files are attached to vector stores, so this implementation skips the embedding step and directly uploads files. ) annotations) TYPE_CHECKINGAnyDictListOptionalTuplecastN)BaseRAGIngestion)acreate)Router)RAGIngestOptionscs:eZdZdZ ddfdd Zdd dZdddZZS)OpenAIRAGIngestiona OpenAI-specific RAG ingestion. Key differences from base: - Embedding is handled by OpenAI when attaching files to vector stores - Files are uploaded and attached to vector stores directly - Chunking is done by OpenAI's vector store (uses 'auto' strategy) Ningest_options'RAGIngestOptions'routerOptional['Router']cstj||ddS)N)rr)super__init__)selfrr __class__]/home/app/Keep/.python/lib/python3.10/site-packages/litellm/rag/ingestion/openai_ingestion.pyr szOpenAIRAGIngestion.__init__chunks List[str]returnOptional[List[List[float]]]csdS)z OpenAI handles embedding internally - skip this step. Returns: None (OpenAI embeds when files are attached to vector store) Nr)rrrrrembed's zOpenAIRAGIngestion.embed file_contentOptional[bytes]filename Optional[str] content_type embeddings#Tuple[Optional[str], Optional[str]]c s|jd}|jd}|jd}|jd} |s8|r"d|dnd} t|jp)dd | || d IdH} | d }d} |rl|rl|rltj|||pGd fd d || dIdH} | j} t|| d tt t t t f|j || dIdH|| fS)a$ Store content in OpenAI vector store. OpenAI workflow: 1. Create vector store (if not provided) 2. Upload file to OpenAI 3. Attach file to vector store (OpenAI handles chunking/embedding) Args: file_content: Raw file bytes filename: Name of the file content_type: MIME type chunks: Ignored - OpenAI handles chunking embeddings: Ignored - OpenAI handles embedding Returns: Tuple of (vector_store_id, file_id) vector_store_idttl_daysapi_keyapi_baseZlast_active_at)anchordaysNzlitellm-rag-ingestZopenai)namecustom_llm_provider expires_afterr(r)idzapplication/octet-streamZ assistants)filepurposer-r(r))r&Zfile_idr-chunking_strategyr(r))Zvector_store_configgetvector_store_acreateZ ingest_namelitellmZ acreate_filer/vector_store_file_acreater rrstrrr2)rrr!r#rr$r&r'r(r)r.Zcreate_responseZresult_file_idZ file_responserrrstore4sD          zOpenAIRAGIngestion.store)N)rrrr)rrrr) rr r!r"r#r"rrr$rrr%)__name__ __module__ __qualname____doc__rrr8 __classcell__rrrrrs    r)r< __future__rtypingrrrrrrr r5Z$litellm.rag.ingestion.base_ingestionr Zlitellm.vector_store_files.mainr r6Zlitellm.vector_stores.mainr4r Zlitellm.types.ragr rrrrrs $