o 1 ið#ã@sŽddlZddlZddlZddlmZddlmZmZmZm Z m Z m Z ddl m Z mZerLddlmZddlmZddlmZddlmZdd lmZmZhd £Zhd £Zhd £Zd dhZhd£ZGdd„deƒZde de e fdd„Z!d7dd„Z"dd„Z#de d fdd„Z$d8d!d"„Z%d#d$„Z&d%d&„Z'd'e ed(d)ee e(ffd*d+„Z)d'e ed(d)e*fd,d-„Z+d9d0d1„Z,d)e*fd2d3„Z-d4ed)dfd5d6„Z.dS):éN)ÚEnum)Ú TYPE_CHECKINGÚDictÚListÚOptionalÚSetÚUnion)ÚTagKeyÚrecord_extra_usage_tag)ÚStorageContext©Ú BaseTrainer©ÚCallback©ÚTrialScheduler©ÚBasicVariantGeneratorÚSearcher>ÚXGBoostTrainerZHorovodTrainerÚLightGBMTrainerÚTensorflowTrainerÚ TorchTrainer>Z JaxTrainerÚDataParallelTrainerrrrr>ZAxSearchZ HEBOSearchZNevergradSearchZBayesOptSearchZTuneBOHBZ OptunaSearchZ ZOOptSearchZHyperOptSearchZConcurrencyLimiterZRepeater> ZPB2Z FIFOSchedulerZResourceChangingSchedulerZPopulationBasedTrainingReplayZHyperBandForBOHBZHyperBandSchedulerZMedianStoppingRuleZAsyncHyperBandSchedulerZPopulationBasedTrainingc@seZdZdZdZdZdZdS)Ú AirEntrypointz Tuner.fitz Trainer.fitztune.runztune.run_experimentsN)Ú__name__Ú __module__Ú __qualname__ZTUNERZTRAINERZTUNE_RUNZTUNE_RUN_EXPERIMENTS©rrúc/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/ray/air/_internal/usage.pyrCs rÚallowed_module_path_prefixÚ whitelistcCs(|j}|jj}| |¡r||vr|SdS)aFind the class name of the object. If the object is not under `allowed_module_path_prefix` or if its class is not in the whitelist, return "Custom". Args: obj: The object under inspection. allowed_module_path_prefix: If the `obj`'s class is not under the `allowed_module_path_prefix`, its class name will be anonymized. whitelist: If the `obj`'s class is not in the `whitelist`, it will be anonymized. Returns: The class name to be tagged with telemetry. ZCustom)rÚ __class__rÚ startswith)Úobjr r!Ú module_pathÚcls_namerrrÚ_find_class_nameJs r'Útrainerr cCó6ddlm}t||ƒs J‚t|dtƒ}ttj|ƒdS)Nrr ú ray.train)Úray.train.trainerr Ú isinstancer'Ú AIR_TRAINERSr r Z AIR_TRAINER)r(r Ú trainer_namerrrÚtag_air_trainer`ó  r/cCr))Nr)rr*)Z&ray.train.v2.api.data_parallel_trainerrr,r'ÚTRAIN_V2_TRAINERSr r Z TRAIN_TRAINER)r(rr.rrrÚtag_train_v2_trainerhr0r2ÚsearchercCsjddlm}m}t||ƒrttjdƒdSt||ƒr1t|dt  t ¡ƒ}|t vr)dSttj|ƒdSJdƒ‚)Nrrrzray.tune.searchFzZNot expecting a non-BasicVariantGenerator, non-Searcher type passed in for `tag_searcher`.) Úray.tune.searchrrr,r r Z TUNE_SEARCHERr'ÚTUNE_SEARCHERSÚunionÚTUNE_SEARCHER_WRAPPERS)r3rrZ searcher_namerrrÚ tag_searcherps   ÿÿr8Ú schedulerrcCr))Nrrzray.tune.schedulers)Úray.tune.schedulersrr,r'ÚTUNE_SCHEDULERSr r ZTUNE_SCHEDULER)r9rZscheduler_namerrrÚ tag_scheduler†r0r<cCóttjdƒdS©NÚ1)r r Z AIR_SETUP_WANDB_INTEGRATION_USEDrrrrÚtag_setup_wandbŽór@cCr=r>)r r Z!AIR_SETUP_MLFLOW_INTEGRATION_USEDrrrrÚtag_setup_mlflow’rArBÚ callbacksrÚreturnc Csìddlm}ddlm}ddlm}ddlm}ddlm }ddl m }ddl m }||||f|}d d „|Dƒ} t t¡} |pAg}|D]/} t| |ƒsLqD| jj} | | vr]| | d 7<qDt| |ƒrk| d d 7<qD| d d 7<qD| S)zHCreates a map of callback class name -> count given a list of callbacks.r)ÚCometLoggerCallback)ÚMLflowLoggerCallback)ÚWandbLoggerCallbackr)ÚLoggerCallback)ÚAimLoggerCallback)ÚDEFAULT_CALLBACK_CLASSEScSsg|]}|j‘qSr)r)Ú.0Z callback_clsrrrÚ §sz$_count_callbacks..éZCustomLoggerCallbackZCustomCallback)Zray.air.integrations.cometrEZray.air.integrations.mlflowrFZray.air.integrations.wandbrGÚray.tunerZray.tune.loggerrHZray.tune.logger.aimrIZray.tune.utils.callbackrJÚ collectionsÚ defaultdictÚintr,r"r) rCrErFrGrrHrIrJZbuilt_in_callbacksZcallback_namesÚcallback_countsÚcallbackZ callback_namerrrÚ_count_callbacks–s6       üû   rTcCs2|sdSt|ƒ}|rt |¡}ttj|ƒdSdS)aRecords built-in callback usage via a JSON str representing a dictionary mapping callback class name -> counts. User-defined callbacks will increment the count under the `CustomLoggerCallback` or `CustomCallback` key depending on which of the provided interfaces they subclass. NOTE: This will NOT track the name of the user-defined callback, nor its implementation. This will NOT report telemetry if no callbacks are provided by the user. Returns: bool: True if usage was recorded, False otherwise. FN)rTÚjsonÚdumpsr r Z AIR_CALLBACKS)rCrRZcallback_counts_strrrrÚ tag_callbacks¼s þrWÚstorager cCs>hd£}|jr d}n |jj|vr|jj}nd}ttj|ƒdS)a§Records the storage configuration of an experiment. The storage configuration is set by `RunConfig(storage_path, storage_filesystem)`. The possible storage types (defined by `pyarrow.fs.FileSystem.type_name`) are: - 'local' = pyarrow.fs.LocalFileSystem. This includes NFS usage. - 'mock' = pyarrow.fs._MockFileSystem. This is used for testing. - ('s3', 'gcs', 'abfs', 'hdfs'): Various remote storage schemes with default implementations in pyarrow. - 'custom' = All other storage schemes, which includes ALL cases where a custom `storage_filesystem` is provided. - 'other' = catches any other cases not explicitly handled above. >ZabfsZhdfsÚlocalZgcsZs3ZmockZcustomÚotherN)Zcustom_fs_providedZstorage_filesystemÚ type_namer r ZAIR_STORAGE_CONFIGURATION)rXr!Zstorage_config_tagrrrÚtag_storage_typeÕs  r\cCs|ddlm}ddlm}ddlm}ttƒ |||¡ƒ}g}|D] }|t j vr,|  |¡q |rs@       þ   "&