o * i#@s.ddlmZddlZddlmZddlmZerddlmZGdddZ Gd d d e Z Gd d d e Z Gd dde Z Gddde Z Gddde ZGddde ZGddde ZGddde ZGddde ZGddde ZGddde ZGdd d e ZGd!d"d"e ZGd#d$d$e ZdS)%) annotationsN) TYPE_CHECKING) constants) _DTypeLiteralc@s@eZdZdddZddZddZdd Zd d Zdd d ZdS) BaseConfigNcCsx||_d|_|durt|tr||_ntd|t|j}|D] \}}t|||q$|jr:| |jdSdSNz%Expected a dictionary. But received: ) _category _config_dict isinstancedict ValueErrorrget_category_default_configitemssetattr from_dict)selfcategory config_dictconfigfield default_valueru/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/paddle/distributed/auto_parallel/strategy.py__init__s  zBaseConfig.__init__cCsBt|j}|D]}||tj}|tjkrt|||q dSN)rrr keysget NOT_FOUNDr)rrrrvaluerrrr-s    zBaseConfig.from_dictcCs^i}t|j}|D] }t||}|||<q |jD]\}}t|tr,| ||<q|Sr) rrr rgetattr__dict__rr rto_dict)r result_dictrrrrrrr"5s      zBaseConfig.to_dictcCs<|}d}|D]\}}|d|d|d7}q |dS)N{"z":"z",})r"r)rr#stringkvrrr__repr__@s zBaseConfig.__repr__cCsH|j}||}||t|<|jD]\}}t||t||q|Sr) __class____new__idr!rrcopydeepcopy)rmemoclsresultr(r)rrr __deepcopy__Gs   zBaseConfig.__deepcopy__cCs|}|||Sr)r"r)rr(dr#rrrrOs zBaseConfig.getr) __name__ __module__ __qualname__rrr"r*r3rrrrrrs  rceZdZdfdd ZZS)RecomputeConfigNctj}t||dSr)r RECOMPUTEsuperrrrrr+rrrUzRecomputeConfig.__init__rr5r6r7r __classcell__rrr>rr9Tr9cr8)FusedLinearPromotionConfigNcr:r)rFUSEDLINEARPROMOTIONr<rr=r>rrr[r?z#FusedLinearPromotionConfig.__init__rr@rrr>rrCZrBrCcseZdZUded<ded<ded<ded<d ed <d ed <ded <ded <ded<ded<ded<ded<ded<ded<ded<dfdd ZZS) AMPConfigboolenablerZdtypestrlevelfloatZinit_loss_scalingintZincr_every_n_stepsZdecr_every_n_nan_or_infZ incr_ratioZ decr_ratioZuse_dynamic_loss_scalingz list[str]Zcustom_white_listZcustom_black_listZcustom_black_varnamesZuse_fp16_guardZuse_bf16_guardZuse_master_gradNcr:r)rAMPr<rr=r>rrrqr?zAMPConfig.__init__rr5r6r7__annotations__rrArrr>rrE`s" rEcs8eZdZUded<ded<ded<d fdd ZZS) ShardingConfigrFrGrKZstageZdegreeNcr:r)rSHARDINGr<rr=r>rrr{r?zShardingConfig.__init__rrMrrr>rrOv rOcs8eZdZUded<ded<ded<d fdd ZZS) GradientMergeConfigrFrGrKZk_stepsZavgNcr:r)rGRADIENT_MERGEr<rr=r>rrrr?zGradientMergeConfig.__init__rrMrrr>rrRrQrRcs@eZdZUded<ded<ded<ded<d fd d ZZS) PipelineConfigrFrGrHZ schedule_moderKZmicro_batch_sizeZaccumulate_stepsNcr:r)rPIPELINEr<rr=r>rrrr?zPipelineConfig.__init__rrMrrr>rrTs rTcr8) QATConfigNcr:r)rQATr<rr=r>rrrr?zQATConfig.__init__rr@rrr>rrVrBrVcr8) TuningConfigNcr:r)rTUNINGr<rr=r>rrrr?zTuningConfig.__init__rr@rrr>rrXrBrXcr8) DatasetConfigNcr:r)rDATASETr<rr=r>rrrr?zDatasetConfig.__init__rr@rrr>rrZrBrZcr8)FusedPassesConfigNcr:r)r FUSED_PASSESr<rr=r>rrrr?zFusedPassesConfig.__init__rr@rrr>rr\rBr\cr8)DPOptimizationConfigNcr:r)rDP_OPTIMIZATIONr<rr=r>rrrr?zDPOptimizationConfig.__init__rr@rrr>rr^rBr^cr8)MPOptimizationConfigNcr:r)rMP_OPTIMIZATIONr<rr=r>rrrr?zMPOptimizationConfig.__init__rr@rrr>rr`rBr`cr8)SPOptimizationConfigNcr:r)rSP_OPTIMIZATIONr<rr=r>rrrr?zSPOptimizationConfig.__init__rr@rrr>rrbrBrbcs"eZdZdZdfdd ZZS)Strategya The `Strategy` object is used to configure the parallelization and optimization for static graph. Args: config (dict|string, optional): If this is None, the default configurations will used. If this is a dictionary, the recognized key-value of it will be used to override the default configurations while other default configurations are left unchanged. If this is a string, it is interpreted as the path to a YAML configuration and will be loaded to override the corresponding default configurations. Examples: .. code-block:: python >>> import paddle >>> from paddle.distributed.fleet import auto >>> strategy = auto.Strategy() >>> sharding = strategy.sharding >>> assert sharding.enable == False >>> assert sharding.stage == 1 >>> assert sharding.degree == 8 >>> sharding.enable = True >>> sharding.stage = 2 >>> sharding.degree = 2 >>> assert sharding.enable == True >>> assert sharding.stage == 2 >>> assert sharding.degree == 2 Ncs|durt|trt||_n td|i|_tj}t ||j|j tj d}t ||_ |j tjd}t||_|j tjd}t||_|j tjd}t||_|j tjd}t||_|j tjd}t||_|j tjd}t||_|j tj d}t!||_"|j tj#d}t$||_%|j tj&d}t'||_(|j tj)d}t*||_+|j tj,d}t-||_.|j tj/d}t0||_1dSr)2r r r.r/r r rZBASEr<rrr;r9Z recomputerLrEamprPrOZshardingrSrRZgradient_mergerUrTZpipelinerWrVZqatrYrXZtuningr[rZZdatasetr]r\Z fused_passesrDrCZfused_linear_promotionr_r^Zdp_optimizationrar`Zmp_optimizationrcrbZsp_optimization)rrrrr>rrrsJ             zStrategy.__init__r)r5r6r7__doc__rrArrr>rrdsrd) __future__rr.typingrrZpaddle._typing.dtype_likerrr9rCrErOrRrTrVrXrZr\r^r`rbrdrrrrs*    ;