o ưi@sddlZddlZddlmZddlmZmZddlmZddl m Z m Z Gdddej Z ded eefd d Zd e d efd dZde ded e fddZdeed efddZdS)N)PathLike)ListOptional)verbose_logger) FileTypesOpenAIFilesPurposecs.eZdZ ddededeffdd ZZS) InMemoryFileapplication/jsonlcontentname content_typecst|||_||_dSN)super__init__r r )selfr r r  __class__W/home/app/Keep/.python/lib/python3.10/site-packages/litellm/router_utils/batch_utils.pyr s  zInMemoryFile.__init__)r )__name__ __module__ __qualname__bytesstrr __classcell__rrrrr srr returnc Csg}d}|D]%}||7}|dkr+zt|}||d}Wqtjy*Yqwq|r^zt|}||W|Stjy]}ztd|ddd||d}~ww|S)ab Parse JSONL content that may contain JSON objects with embedded newlines in string values. Unlike splitlines(), this function properly handles cases where JSON string values contain literal newline characters, which would otherwise break simple line-based parsing. Args: content: The JSONL file content as a string Returns: List of parsed JSON objects Example: >>> content = '{"id":1,"msg":"Line 1\nLine 2"}\n{"id":2,"msg":"test"}' >>> parse_jsonl_with_embedded_newlines(content) [{"id":1,"msg":"Line 1\nLine 2"}, {"id":2,"msg":"test"}]  zerror parsing final buffer: Ndz ..., error: )jsonloadsstripappendJSONDecodeErrorrerror)r json_objectsbufferchar json_objecterrr"parse_jsonl_with_embedded_newliness4   r*purposecCs|dkrdSdS)z Check if the model name should be replaced in the JSONL file for the deployment model name. Azure raises an error on create batch if the model name for deployment is not in the .jsonl. batchTFr)r+rrrshould_replace_model_in_jsonlBsr- file_contentnew_model_namec Cszjt|tr |WSt|dr|}n t|tr|d}n|}t|tr*|d}n t|tr2|}n|WSt|}t |dkrB|WSg}|D]}d|vrR||dd<| t |qFd |d}t|dd d WSt jttfyy|YSw) Nreadzutf-8rbodymodelrzmodified_file.jsonlr )r r ) isinstancerhasattrr0tuplerdecoderr*lenr"rdumpsjoinencoderr#UnicodeDecodeError TypeError)r.r/Zfile_content_bytesZfile_content_strr%Zmodified_linesr(Zmodified_file_contentrrrreplace_model_in_jsonlOs4          r> function_namecs.tgd}rtfdd|DrdSdS)z Helper to return what the "metadata" field should be called in the request data For all /thread or /assistant endpoints we need to call this "litellm_metadata" For ALL other endpoints we call this "metadata )r,Zgeneric_api_callZ_acreate_batchfileZ!_ageneric_api_call_with_fallbacksc3s|]}|vVqdSr r).0methodr?rr s z5_get_router_metadata_variable_name..Zlitellm_metadatametadata)setany)r?Z%ROUTER_METHODS_USING_LITELLM_METADATArrCr"_get_router_metadata_variable_names rH)iorosrtypingrrZlitellm._loggingrZlitellm.types.llms.openairrBytesIOrrdictr*boolr-r>rHrrrrs   /  2