o ưi@sPddlZddlmZmZddlmZerddlmZeZ neZ GdddZ dS)N) TYPE_CHECKINGAny)calculate_max_parallel_requests)Routerc@s"eZdZededefddZdS)InitalizeCachedClientlitellm_router_instancemodelc Cs|di}|dd}|dd}|dd}|dd}t||||jd}|r>t|}|d} |jj| |d d dSdS) Nlitellm_paramsZ model_infoidrpmtpmmax_parallel_requests)r r r default_max_parallel_requestsZ_max_parallel_requests_clientT)keyvalue local_only)getrrasyncio SemaphorecacheZ set_cache) rrr Zmodel_idr r r Z calculated_max_parallel_requestsZ semaphore cache_keyrf/home/app/Keep/.python/lib/python3.10/site-packages/litellm/router_utils/client_initalization_utils.py set_max_parallel_requests_clients(        z6InitalizeCachedClient.set_max_parallel_requests_clientN)__name__ __module__ __qualname__ staticmethod LitellmRouterdictrrrrrrsr) rtypingrrZ litellm.utilsrZlitellm.routerrZ_Routerrrrrrrs