o 1 i* @sUdZddlZddlZddlZddlmZddlmZddlm Z m Z m Z m Z ddl Z ddlmZddlmZddlmZdd lmZdd lmZmZmZdd lmZdd lmZdd lmZddl m!Z!e"eZ#da$de%d<da&ee%d<e!eGdddZ' dNde(de(de efddZ)ddZ*ddZ+dede d ed!e,d"e,f d#d$Z-dOde(defd%d&Z.edd'Gd(d)d)Z/ej0d*dd+Z1ej0d,dd+Z2d-d.Z3d/d0Z4 1 1 1 1 1dPd2e5d3e5d4e5d5e5d6e5f d7d8Z6d9d:Z7d;e e/fd<d?e5de e5ej;ffd@dAZee9Z?e e5e e5effe%dG<dHdIZ@dJdKZAdLdMZBdS)Qz This file stores global state for a Serve application. Deployment replicas can use this state to access metadata or the Serve controller. N) defaultdict) dataclass)CallableDictListOptional) RayActorError)ServeControllerClient) ReplicaID)DeploymentConfig)SERVE_CONTROLLER_NAMESERVE_LOGGER_NAMESERVE_NAMESPACE) ReplicaResult)RayServeException)RayServegRPCContext) DeveloperAPIReplicaContext_INTERNAL_REPLICA_CONTEXT_global_clientc@speZdZUdZeed<eed<eed<eed<eed<e de fdd Z e de fd d Z e de fd d Z dS)raStores runtime context info for replicas. Fields: - app_name: name of the application the replica is a part of. - deployment: name of the deployment the replica is a part of. - replica_tag: unique ID for the replica. - servable_object: instance of the user class/function this replica is running. - rank: the rank of the replica. - world_size: the number of replicas in the deployment. replica_idservable_object_deployment_configrank world_sizereturncC |jjjSN)r deployment_idapp_nameselfr"]/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/ray/serve/context.pyr6 zReplicaContext.app_namecCrr)rrnamer r"r"r# deployment:r$zReplicaContext.deploymentcCs|jjSr)r unique_idr r"r"r# replica_tag>zReplicaContext.replica_tagN)__name__ __module__ __qualname____doc__r __annotations__rr intpropertystrrr&r(r"r"r"r#r"s  FT_health_check_controllerraise_if_no_controller_runningrcCsZztdur|rttjjtWSWt |Sty,tdt dYt |Sw)aGets the global client, which stores the controller's handle. Args: _health_check_controller: If True, run a health check on the cached controller if it exists. If the check fails, try reconnecting to the controller. raise_if_no_controller_running: Whether to raise an exception if there is no currently running Serve controller. Returns: ServeControllerClient to the running Serve controller. If there is no running controller and raise_if_no_controller_running is set to False, returns None. Raises: RayServeException: If there is no running Serve controller actor and raise_if_no_controller_running is set to True. Nz-The cached controller has died. Reconnecting.) rraygetZ _controllerZ check_aliveremoterloggerinfo_set_global_client_connect)r2r3r"r"r#_get_global_clientCs  r;cCs|adSr)r)clientr"r"r#r9er)r9cCstSr)rr"r"r"r#_get_internal_replica_contextjsr=rrrrrcCst|||||dadS)Nrrrrr)rrr>r"r"r#_set_internal_replica_contextns  r?cCshdtjjj_tstjtdz tjt td}Wnt y)|r&t dYdSwt |}t ||S)aOConnect to an existing Serve application on this Ray cluster. If called from within a replica, this will connect to the same Serve app that the replica is running in. Returns: ServeControllerClient that encapsulates a Ray actor handle to the existing Serve application's Serve Controller. None if there is no running Serve controller actor and raise_if_no_controller_running is set to False. Raises: RayServeException: If there is no running Serve controller actor and raise_if_no_controller_running is set to True. F) namespacez7There is no Serve instance running on this Ray cluster.N)r4Z_privateZworkerZ global_workerZ_filter_logs_by_jobZis_initializedinitrZ get_actorr ValueErrorrr r9)r3 controllerr<r"r"r#r:s"   r:)frozenc@sreZdZUdZeed<dZeed<dZeed<dZeed<dZ eed<dZ e e ed<d Z eed <d Zeed <dS) _RequestContextroute request_id_internal_request_idrmultiplexed_model_idN grpc_contextFis_http_requestcancel_on_parent_request_cancel)r*r+r,rGr1r.rHrIrrJrKrrrLboolrMr"r"r"r#rEs      rEz'Serve internal request context variable)defaultz0Serve internal batching request context variablecCs tdur tttS)zWGet the current request context. Returns: The current request context N)_serve_request_contextr5setrEr"r"r"r#_get_serve_request_contexts  rRcCstdur tgtS)z7Get the list of request contexts for the current batch.N)_serve_batch_request_contextr5rQr"r"r"r# _get_serve_batch_request_contexts  rTrFrGrHrIrrJc Cs@t}tt|p |j|p|j|p|j|p|j|p|jddS)z]Set the request context. If the value is not set, the current context value will be used.)rGrHrIrrJN) rRrPrQrErGrHrIrrJ)rGrHrIrrJZcurrent_request_contextr"r"r#_set_request_contexts rUcCsttdS)zUnset the request context.N)rPrQrEr"r"r"r#_unset_request_contextsrVrequest_contextscCst|dS)z5Add the request context to the batch request context.N)rSrQ)rWr"r"r#_set_batch_request_contextsrX_requests_pending_assignmentparent_request_idcC|tvrt|SiSrrYrZr"r"r# _get_requests_pending_assignmentr^ response_idcC|t||<dSrr\)rZr`taskr"r"r#_add_request_pending_assignmentsrccC4|t|vr t||=tt|dkrt|=dSdSNr)rYlenrZr`r"r"r#"_remove_request_pending_assignment    rh_in_flight_requestscCr[rrjr]r"r"r#_get_in_flight_requests7r_rlcCrarrk)rZr`Zreplica_resultr"r"r#_add_in_flight_request>srmcCrdre)rjrfrgr"r"r#_remove_in_flight_requestBrirn)FT)T)rFrFrFrFrF)Cr-asyncio contextvarslogging collectionsr dataclassesrtypingrrrrr4Zray.exceptionsrZray.serve._private.clientr Zray.serve._private.commonr Zray.serve._private.configr Zray.serve._private.constantsr r rZ!ray.serve._private.replica_resultrZray.serve.exceptionsrZray.serve.grpc_utilrZray.util.annotationsr getLoggerr7rr.rrrNr;r9r=r/r?r:rE ContextVarrPrSrRrTr1rUrVrXdictrYTaskr^rcrhrjrlrmrnr"r"r"r#s               " 6   "