o rq i7 @sHddlZddlZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z m Z ddlmZmZmZmZddlmZmZmZmZmZmZmZddlmZddlmZeZd d Z d d Z!dFddZ"de e#e e#ffddZ$ddZ%de&de#fddZ'de#de&fddZ(de#de#fddZ)dGde e#fdd Z*d!d"Z+dFd#d$Z,d%d&Z-d'd(Z.  )dHd*e#d+e e#d,e e#ddfd-d.Z/d/Z0d0e1de#fd1d2Z2d3e e e e#e&fd4e e#de#fd5d6Z3d7d8Z4ej5dd9d:e e#efd;e e1de eddffddId?e e&e#efd@e#de efdAdBZ7dCe#de#fdDdEZ8dS)JN)datetime)Path) GeneratorListOptionalUnion) BaseFileLockFileLock SoftFileLockTimeout)DEFAULT_MODELSCOPE_DOMAINDEFAULT_MODELSCOPE_GROUPDEFAULT_MODELSCOPE_INTL_DOMAINMODEL_ID_SEPARATORMODELSCOPE_DOMAINMODELSCOPE_SDK_DEBUGMODELSCOPE_URL_SCHEME)FileIntegrityError) get_loggercCs<t|vr|td}|td}||fSt}|}||fS)Nr)rsplitr )model_idZgroup_or_ownernamera/home/app/PaddleOCR-VL/.venv_paddleocr/lib/python3.10/site-packages/modelscope/hub/utils/utils.pymodel_id_to_group_owner_namesrcCstj|d}|dkS)Ntrue)osenvirongetstriplower)var_namevaluerrr is_env_true%sr%TcCs*ttjvrttrttS|rtStSN)rrrgetenvr rZcn_siterrr get_domain*s  r) raw_inputcCsd}t|tr#t}d|vrdd|dD}|S|||St|trNt}|D] }t|trMd|vrF|dd|dDq-||q-|S)N,cSg|]}|qSrr!).0srrr 8z$convert_patterns..cSr,rr-)r.ssrrrr0@r1) isinstancestrlistrappendr!extend)r*outputr/rrrconvert_patterns3s"    r9cCsDtjdr |dd}n|dd}tj|d|dd}|S)Nwin\/r.Z___)sysplatform startswithrsplitrpathjoinreplace) directoryrpartsZmasked_directoryrrrget_model_masked_directoryHs  rH size_bytesreturncCsZddl}|dkr dSd}t|||d}|d|}t||d}|d||S)NrZ0B) BZKBMBGBTBPBEBZBYBir< )mathintfloorlogpowround)rIrTZ size_nameipr/rrrconvert_readable_sizeRs r\ folder_pathcCs2d}t|dD] }|r||j7}q |S)Nr*)rrglobis_filestatst_size)r] total_sizerCrrrget_folder_size]s rdcCstt|dS)Nr])r\rdrerrrget_readable_folder_sizefsrfrcCsDtdd}tdtj|d}|dur|Stj||dS)zcache dir precedence: function parameter > environment > ~/.cache/modelscope/hub Args: model_id (str, optional): The model id. Returns: str: the model_id dir if model_id not None, otherwise cache root dir. z.cache modelscopeZMODELSCOPE_CACHEZhubNr=)rhomejoinpathrr'rCrD)rZdefault_cache_dir base_pathrrr get_cache_dirjs rkcCsLttjvrttt}|Sddlm }ttt |j d}|S)Nr)version%Y-%m-%d %H:%M:%S) rrrrUrYrnow timestamprgrlstrptimeZ__release_datetime__)rtrlrrrget_release_datetimeys  rrcCs tt|Sr&)rr)r(rrr get_endpoints rscCsbd}t}t|d} ||}|sn||q Wd|S1s(wY|S)Nirb)hashlibsha256openreadupdate hexdigest) file_path BUFFER_SIZEZ sha256_hashfdatarrr compute_hashs    rcCs>t|}||kst|d|||f}t|t|dS)zValidate the file hash is expected, if not, delete the file Args: file_path (str): The file to validate expected_sha256 (str): The expected sha256 hash Raises: FileIntegrityError: If file_path hash is not expected. zFile %s integrity check failed, expected sha256 signature is %s, actual is %s, the download may be incomplete, please try again.N)rrremoveloggererrorr)r{Zexpected_sha256Z file_sha256msgrrrfile_integrity_validations   rF file_namepatternscommit_messagec Csbt|tr|g}|durd|dd|}|j}tj||}tj|rBt|ddd }|}Wdn1ssz&tabulate...)max)r.colrrrr0sztabulate..z{{:{}}} cSsg|]}d|qS)-r)r.rrrrr0r1r)ziprformatr6rD)rrZ col_widthsZ row_formatlinesrowrrrtabulates rcCs.|}|dvr dS|dvrdStd|)N>ryes1onytr>false0offnonr}rzinvalid truth value )r" ValueError)valrrr strtobools rtimeout lock_filerccsd}t||d}t} t|}|dur"||kr"tt|z|j|r.t|||n|dWnCtyMtd|dt|ddYn+tyv}zdt|vrlt d |t ||d}WYd}~q WYd}~nd}~wwnqz*|VWz| WdSt yz t |WYdSt yYnwYdSwz| Wwt yz t |WYwt yYYwww) NrrTz!Still waiting to acquire lock on z (elapsed: z.1fz seconds)zuse SoftFileLock insteadzPFileSystem does not appear to support flock. Falling back to SoftFileLock for %s)r rr r4acquireminrinfoNotImplementedErrorwarningr releaseOSErrorrunlink)rrZdefault_intervallock start_timeZ elapsed_timerrrrweak_file_locksh             r Asia/Shanghai time_stamp time_zonec Cs|sdSt|tr |St|trzv|dr\d|vr#|ddd}n|ddd\}}|dddd}|d|d}t|djt d d }|d krY| t |}|WSgd }|D]}zt||jt |d WWSt y~Yqbwt d |d t y}z t d|d|d}~wwt|t rztj |t d d t |WSt tfy}z t d|d|d}~wwtdt|d)a>Convert a UNIX/string timestamp to a timezone-aware datetime object. Args: time_stamp: UNIX timestamp (int), ISO string, or datetime object time_zone: Target timezone for non-UTC timestamps (default: 'Asia/Shanghai') Returns: Timezone-aware datetime object or None if input is None NZr>z.000000Zrrz%Y-%m-%dT%H:%M:%S.%fZUTC)tzinfo)z%Y-%m-%dT%H:%M:%S.%fz%Y-%m-%dT%H:%M:%Sz%Y-%m-%d %H:%M:%S.%frmzUnsupported timestamp format: ''zCannot parse 'zr' as a datetime. Expected formats: 'YYYY-MM-DDTHH:MM:SS[.ffffff]Z' (UTC) or 'YYYY-MM-DDTHH:MM:SS[.ffffff]' (local))tzzCannot convert 'z2' to datetime. Ensure it's a valid UNIX timestamp.zUnsupported type 'z"'. Expected int, str, or datetime.)r3rr4rrljustrprEzoneinfoZZoneInfo astimezonerrU fromtimestampr TypeErrortype)rrbasefractiondtformatsfmtrrrrconvert_timestamp1s           r image_pathcCsddl}ddl}tj|}tj|std|tj|s(td|| |\}}|r6| ds=td|t |d}| }| |d}Wdn1sYwYd |d |S) a+ Encode image file to base64 string. Args: image_path (str): Path to the image file Returns: str: Base64 encoded string with data URL prefix Raises: FileNotFoundError: If image file doesn't exist ValueError: If file is not a valid image format rNzImage file not found: zPath is not a file: zimage/z"File is not a valid image format: rtrzdata:z;base64,)base64 mimetypesrrC expanduserrFileNotFoundErrorisfiler guess_typerArwrx b64encodedecode)rrrZ mime_type_Z image_fileZ image_dataZ base64_datarrrencode_image_to_base64s    r)Tr&)NF)r)9 contextlibrurr?rrrpathlibrtypingrrrrZfilelockrr r r Zmodelscope.hub.constantsr r rrrrrZmodelscope.hub.errorsrZmodelscope.utils.loggerrrrr%r)r4r9rHrUr\rdrfrkrrrsrrrrfloatrrrcontextmanagerrrrrrrrsp  $          ( *    , N