o ưi[@sVddlZddlmZmZddlmZmZmZmZm Z m Z ddl Z ddl m Z ddlTddlmZddlmZddlmZdd lmZdd lmZeZdd lmZdad d ZdefddZej deegdgddej deegdgddeefde de dede!fddZ"ej#deegdgddej#deegdgdddeefde de dedee$d de!f d!d"Z%ej#deegdgd#dej#deegdgd#ddedd$d%ddeefde de dee$d d&eed'eed(ee&de!fd)d*Z'ej d+eegdgd,dej d-eegdgd,deefde de dede!fd.d/Z(dS)0N)Optionalcast) APIRouterDepends HTTPExceptionQueryRequestResponse)verbose_proxy_logger)*)user_api_key_auth)ProxyBaseLLMRequestProcessing)"_is_base64_encoded_unified_file_id)handle_exception_on_proxy)LiteLLMFineTuningJob)LiteLLMFineTuningJobCreatecCsn|durdSt|tstd|D]!}t|tr2|D]\}}t|tr1|dr1t|||<qq|a dS)Nz9invalid fine_tuning config, expected a list is not a listz os.environ/) isinstancelist ValueErrordictitemsstr startswithlitellmZ get_secretfine_tuning_config)configelementkeyvaluerd/home/app/Keep/.python/lib/python3.10/site-packages/litellm/proxy/fine_tuning_endpoints/endpoints.pyset_fine_tuning_configs  r!custom_llm_providercCs4tdurtdtD] }|d|kr|Sq dS)Nz?fine_tuning_config is not set, set it on your config.yaml file.r")rrget)r"Zsettingrrr get_fine_tuning_provider_config1sr$z/v1/fine_tuning/jobsz fine-tuningu'✨ (Enterprise) Create Fine-Tuning Job) dependenciestagssummaryz/fine_tuning/jobsrequestfastapi_responsefine_tuning_requestuser_api_key_dictc s@ddlm}m}m}m}m}m} |jdd} z|dur%tdt j j t dtj| ddt| d } | j|||| ||d d Id H\} } d } |j}d }|rUt|} | r{ |d urdtdddidtt|jd"i| Id H}| |_| |jd<n|jrt|jd}|d ur| |tjd"i| Id H}|d urtd|j| ||dId H}|d urt|tr|}t !|j"| #ddddt$|dipi}|#dd pd}|#dd pd}|#dd pd}|j%tj&||||| t$|ddd|WSt'y}z|j(||| d Id Ht )d!t*|t+|d }~ww)#ad Creates a fine-tuning job which begins the process of creating a new model from a given dataset. This is the equivalent of POST https://api.openai.com/v1/fine_tuning/jobs Supports Identical Params as: https://platform.openai.com/docs/api-reference/fine-tuning/create Example Curl: ``` curl http://localhost:4000/v1/fine_tuning/jobs -H "Content-Type: application/json" -H "Authorization: Bearer sk-1234" -d '{ "model": "gpt-3.5-turbo", "training_file": "file-abc123", "hyperparameters": { "n_epochs": 4 } }' ``` rgeneral_settings llm_router premium_user proxy_configproxy_logging_objversionT)Z exclude_none+Only premium users can use this endpoint + zRequest received by LiteLLM: {})indentdataacreate_fine_tuning_jobr(r-r+r2r1r0Z route_typeNFerror9LLM Router not initialized. Ensure models added to proxy. status_codedetailunified_file_idr"LInvalid request, No litellm managed file id or custom_llm_provider provided.r7r+responselitellm_call_idsuccessrEstatus_hidden_paramsmodel_id cache_keyapi_baseallowed_model_regionr+rKrLrMr2Z model_regionr+Zoriginal_exceptionZ request_datazLlitellm.proxy.proxy_server.create_fine_tuning_job(): Exception occurred - {}r),litellm.proxy.proxy_serverr-r.r/r0r1r2Z model_dumprCommonProxyErrorsnot_premium_userrr debugformatjsondumpsr common_processing_pre_call_logic training_filerrrrr8rJr"r$updaterpost_call_success_hookrasyncio create_taskupdate_request_statusr#getattrheadersget_custom_headers Exceptionpost_call_failure_hook exceptionrr)r(r)r*r+r-r.r/r0r1r2r7base_llm_response_processorlitellm_logging_objr@rYrDllm_provider_config _response hidden_paramsrKrLrMerrr create_fine_tuning_job?s &            rkz./v1/fine_tuning/jobs/{fine_tuning_job_id:path}u)✨ (Enterprise) Retrieve Fine-Tuning Jobz+/fine_tuning/jobs/{fine_tuning_job_id:path}fine_tuning_job_id)ZopenaiZazurec sRddlm}m}m}m}m} m} d|i} z|dur#tdtj j t | d} | j |||| | |t jj dIdH\} } z |IdH}Wn tyOi}Ynw|d dpW|}d }d}|rbt|}|r|durptd d d idtt|jd i| IdH}||jd<n|rt|d}|dur| |tjd i| IdH}|durtddd| j| ||dIdH}|durt|tr|}t| j| ddddt|dipi}|ddpd}|ddpd}|ddpd}|j t j!||||| t|ddd|WSty(}z| j"||| dIdHt#$d%t&|t'|d}~ww)!a& Retrieves a fine-tuning job. This is the equivalent of GET https://api.openai.com/v1/fine_tuning/jobs/{fine_tuning_job_id} Supported Query Params: - `custom_llm_provider`: Name of the LiteLLM provider - `fine_tuning_job_id`: The ID of the fine-tuning job to retrieve. rr,rlTr3r6r9Nr"Fr:r;r<r=unified_finetuning_job_idrArBrCrErFrGrHrJrKrLrMrNrOrPzNlitellm.proxy.proxy_server.retrieve_fine_tuning_job(): Exception occurred - {}r)(rQr-r.r/r0r1r2rrRrSrr rX CallTypesZaretrieve_fine_tuning_jobrVrbr#rrrrrJr$rZrr[rr\r]r^r_r`rarcr rdrUrr)r(r)rlr"r+r-r.r/r0r1r2r7rerf request_bodyrmrDrgrhrirKrLrMrjrrr retrieve_fine_tuning_jobs               rqu&✨ (Enterprise) List Fine-Tuning JobszOComma separated list of model names to filter by. Example: 'gpt-4o,gpt-4o-mini')default descriptiontarget_model_namesafterlimitc sddlm}m}m} m} m} m} i} z| dur!tdtj j t | d}|j |||| | | t jj dIdH\} }d}|rvt|trv|d}t|d krStd d d |dur]td dd |d| d<|jdi| ||dIdH}|WS|rt|d}|dur| |tjdi| ||dIdH}|durtd dd t|dipi}|ddpd}|ddpd}|ddpd}|jt j||||| t|ddd|WSty}z| j||| dIdHtdt|t |d}~ww)ar Lists fine-tuning jobs for the organization. This is the equivalent of GET https://api.openai.com/v1/fine_tuning/jobs Supported Query Params: - `custom_llm_provider`: Name of the LiteLLM provider - `after`: Identifier for the last job from the previous pagination request. - `limit`: Number of fine-tuning jobs to retrieve (default is 20). rr,Tr3r6r9N,rnzatarget_model_names on list fine-tuning jobs must be a list of one model name. Example: ['gpt-4o']r=r:r<model)rurvrArBrJrKrFrLrMrNrOrPzKlitellm.proxy.proxy_server.list_fine_tuning_jobs(): Exception occurred - {}r)!rQr-r.r/r0r1r2rrRrSrr rXroZalist_fine_tuning_jobsrrsplitlenrr$rZrr_r#r`rarbrcr rdrUr)r(r)r"rtrurvr+r-r.r/r0r1r2r7rerfrDZtarget_model_names_listrgrirKrLrMrjrrr list_fine_tuning_jobsxs !            r|z5/v1/fine_tuning/jobs/{fine_tuning_job_id:path}/cancelu(✨ (Enterprise) Cancel Fine-Tuning Jobsz2/fine_tuning/jobs/{fine_tuning_job_id:path}/cancelc sJddlm}m}m}m}m}m} d|i} z|dur#tdtj j t | d} | j |||| ||t jj dIdH\} } z |IdH} Wn tyOi} Ynw| d d}d }d}|r`t|}|r|durntd d d idtt|jd i| IdH}||jd<nt|d}|dur| |tjd i| IdH}|durtddd|j| ||dIdH}|durt|tr|}t|j| ddddt|dipi}|ddpd}|ddpd}|ddpd}|j t j!||||| t|ddd|WSty$}z|j"||| dIdHt#$d%t&|t'|d}~ww)!a* Cancel a fine-tuning job. This is the equivalent of POST https://api.openai.com/v1/fine_tuning/jobs/{fine_tuning_job_id}/cancel Supported Query Params: - `custom_llm_provider`: Name of the LiteLLM provider - `fine_tuning_job_id`: The ID of the fine-tuning job to cancel. rr,rlTr3r6r9Nr"Fr:r;r<r=rmrArnrBrCrErFrGrHrJrKrLrMrNrOrPzLlitellm.proxy.proxy_server.cancel_fine_tuning_job(): Exception occurred - {}r)(rQr-r.r/r0r1r2rrRrSrr rXroZacancel_fine_tuning_jobrVrbr#rrrrrJr$rZrr[rr\r]r^r_r`rarcr rdrUrr)r(r)rlr+r-r.r/r0r1r2r7rerfrpr"rmrDrgrhrirKrLrMrjrrr cancel_fine_tuning_jobs                r}))r\typingrrZfastapirrrrrr rZlitellm._loggingr Zlitellm.proxy._typesZ$litellm.proxy.auth.user_api_key_authr Z'litellm.proxy.common_request_processingr Z1litellm.proxy.openai_files_endpoints.common_utilsrZlitellm.proxy.utilsrZlitellm.types.utilsrZrouterZlitellm.types.llms.openairrr!rr$postZUserAPIKeyAuthrkr#Literalrqintr|r}rrrr s                {