o ưi @sdZddlZddlmZmZmZmZmZddlm Z er%ddl m Z e Z neZ de deeeeeeffded efd d ZdS) z Returns a random deployment from the list of healthy deployments. If weights are provided, it will return a deployment based on the weights. N) TYPE_CHECKINGAnyDictListUnion)verbose_router_logger)Routerllm_router_instancehealthy_deploymentsmodelreturnc sdD]p|ddd}|durrfdd|D}td|t|fdd|D}td |d tjtt||d d}td |||}td |d| |pc|dd||po|dSqt |}|p}|dS)a Returns a random deployment from the list of healthy deployments. If weights are provided, it will return a deployment based on the weights. If users pass `rpm` or `tpm`, we do a random weighted pick - based on `rpm`/`tpm`. Args: llm_router_instance: LitellmRouter instance healthy_deployments: List of healthy deployments model: Model name Returns: Dict: A single healthy deployment )weightZrpmZtpmrlitellm_paramsNcsg|] }|ddqS)rr)get).0m) weight_by]/home/app/Keep/.python/lib/python3.10/site-packages/litellm/router_strategy/simple_shuffle.py .sz"simple_shuffle..z weight csg|]}|qSrr)rr ) total_weightrrr1sz weights z by )weightsz selected index, z$get_available_deployment for model: z, Selected deployment: z for model: ) rrdebugsumrandomchoicesrangeleninfoZprint_deploymentchoice)r r r r rZselected_indexZ deploymentitemr)rrrsimple_shuffles$"  r!)__doc__rtypingrrrrrZlitellm._loggingrZlitellm.routerrZ_RouterZ LitellmRouterstrr!rrrrs"