o `)iz>@sUddlZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl Z ddlmZmZmZmZmZmZmZmZmZmZddlmZddlZddlZddlmZddl m!Z!m"Z"dZ#d\d e$d ee$ej%fd e&d dfd dZ'd]dee$ej%fd e&d e$fddZ(dee$ej%fde$ded e)fddZ*d^dee$ej%fdee$d e)fddZ+d_d e$de&d e$fddZ,d e$d ee$fddZ-   d`d e$dee$ej%fd eee$ej%fdee$d e&d df d!d"Z.dadee$ej%fd$e)d ee$fd%d&Z/dadee$ej%fd'e$d$e)d ee$fd(d)Z0  dbd*e$dee$ej%fd eee$ej%fdee$fd+d,Z1d-ee$ej%fd.ee$ej%fd/ee$d dfd0d1Z2e j3e j4d2Z5ee$e&fe6d3<d-ee$ej%fd.ee$ej%fd/ee$d dfd4d5Z7e2e7d6Z8ee$eee$ej%fee$ej%fee$gdffe6d7<ej9ej9ej9d8Z:ee$ed9effe6d:<d;d;d<d?ee$ej%fd ee$ee$ee$ffd@dAZ<  #dcd-ee$ej%fd.eee$ej%fdBe)d ej%fdCdDZ=  #dcd-ee$ej%fd.eee$ej%fdBe)d ee$ej%ffdEdFZ>    #ddd e$dGee$ej%fdHeee$ej%fd eee$ej%fdee$dBe)d dfdIdJZ?dKed e$fdLdMZ@edNe$eAZB   dedOeBdPee$dQeeeBdRee$d eBf dSdTZCdfdUee$ej%fdVe&d ejDfdWdXZEdYejFd ejFfdZd[ZGdS)gN) AnyCallableDictIOIterableListOptionalTupleTypeVarUnion)urlparse)tqdm)#_download_file_from_remote_location_is_remote_location_availablezpytorch/visionurlfilename chunk_sizereturnc Cstjtjj|dtidX}t|d:}t|jddd"}||}r8| || t |||}s%Wdn1sBwYWdn1sQwYWddSWddS1siwYdS)N User-AgentheaderswbBT)totalunitZ unit_scale) urllibrequesturlopenRequest USER_AGENTopenr lengthreadwriteupdatelen)rrrresponsefhZpbarchunkr+f/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/torchvision/datasets/utils.py _urlretrieves "r-fpathcCstjdkr tjdd}nt}t|d(}||}r3||||}sWd|SWd|S1s@wY|S)N) F)usedforsecurityrb)sys version_infohashlibmd5r"r$r& hexdigest)r/rr7fr*r+r+r, calculate_md5#s     r:r7kwargscKs|t|fi|kSN)r:)r/r7r;r+r+r, check_md51sr=cCs&tj|sdS|durdSt||S)NFT)ospathisfiler=)r/r7r+r+r,check_integrity5s  rAr0max_hopsc Cs|}dtd}t|dD]6}tjtjj||d }|j|ks&|jdur1|WdS|j}Wdn1s>wYq td|d|d|d) NHEAD)ZMethodrrz Request to z exceeded z( redirects. The last redirect points to .)r!rangerrrr rRecursionError)rrBZ initial_urlr_r(r+r+r,_get_redirect_url=s rIcCsBt|}td|jdurdStd|j}|durdS|dS)Nz(drive|docs)[.]google[.]comz/file/d/(?P[^/]*)id)r rematchnetlocr?group)rpartsrLr+r+r,_get_google_drive_file_idMs rProotmax_redirect_hopsc Cstj|}|stj|}ttj||}tj|ddt||r&dStr/t ||nIt ||d}t |}|durDt ||||Szt ||Wn,tjjtfyw}z|dddkrk|dd}t ||n|WYd}~nd}~wwt||std dS) aDownload a file from a url and place it in root. Args: url (str): URL to download file from root (str): Directory to place downloaded file in filename (str, optional): Name to save the file under. If None, use the basename of the URL md5 (str, optional): MD5 checksum of the download. If None, do not check max_redirect_hops (int, optional): Maximum number of redirect hops allowed Texist_okN)rBhttpszhttps:zhttp:File not found or corrupted.)r>r? expanduserbasenamefspathjoinmakedirsrArrrIrPdownload_file_from_google_driver-rerrorURLErrorOSErrorreplace RuntimeError)rrQrr7rRr/file_ider+r+r, download_urlZs4         reFprefixcsBtjfddtD}|durfdd|D}|S)a List all directories at a given root Args: root (str): Path to directory whose folders need to be listed prefix (bool, optional): If true, prepends the path to each result, otherwise only returns the name of the directories found cs&g|]}tjtj|r|qSr+)r>r?isdirr[.0prQr+r, s&zlist_dir..Tcg|] }tj|qSr+r>r?r[ridrkr+r,rlr>r?rXlistdir)rQrf directoriesr+rkr,list_dirs rusuffixcsDtjfddtD}|dur fdd|D}|S)aList all files ending with a suffix at a given root Args: root (str): Path to directory whose folders need to be listed suffix (str or tuple): Suffix of the files to match, e.g. '.png' or ('.jpg', '.png'). It uses the Python "str.endswith" method and is passed directly prefix (bool, optional): If true, prepends the path to each result, otherwise only returns the name of the files found cs0g|]}tjtj|r|r|qSr+)r>r?r@r[endswithrhrQrvr+r,rls0zlist_files..Tcrmr+rnrorkr+r,rlrqrr)rQrvrffilesr+rxr, list_filess rzrccCszddl}Wn tytdwtj|}|s|}ttj||}tj|ddt ||r4dS|j ||dt dt ||sFtddS) afDownload a Google Drive file from and place it in root. Args: file_id (str): id of file to be downloaded root (str): Directory to place downloaded file in filename (str, optional): Name to save the file under. If None, use the id of the file. md5 (str, optional): MD5 checksum of the download. If None, do not check rNz`To download files from GDrive, 'gdown' is required. You can install it with 'pip install gdown'.TrSF)rJoutputquiet user_agentrW) gdownModuleNotFoundErrorrbr>r?rXrZr[r\rAdownloadr!)rcrQrr7r~r/r+r+r,r]s$     r] from_pathto_path compressioncCsRt||rd|ddnd}||WddS1s"wYdS)Nzr:rDr)tarfiler" extractall)rrrtarr+r+r, _extract_tars$ "r).bz2.xz_ZIP_COMPRESSION_MAPcCsNtj|d|r t|ntjd}||WddS1s wYdS)Nr)r)zipfileZipFiler ZIP_STOREDr)rrrzipr+r+r, _extract_zips  "r).tarz.zip_ARCHIVE_EXTRACTORS)r.gzr._COMPRESSED_FILE_OPENERS)rr)rr)z.tbzz.tbz2z.tgz_FILE_TYPE_ALIASESfilecCst|j}|std|d|d}|tvr |gt|RS|tvr)||dfS|tvrGt|dkrB|d}|tvrB||||fS|d|fStt tt tBt tB}td|d|d ) aDetect the archive type and/or compression of a file. Args: file (str): the filename Returns: (tuple): tuple of suffix, archive type, and compression Raises: RuntimeError: if file has no suffix or suffix is not supported zFile 'zP' has no suffixes that could be used to detect the archive type and compression.NrDz&Unknown compression or archive type: 'z'. Known suffixes are: 'z'.) pathlibPathsuffixesrbrrrr'sortedset)rrrvZsuffix2Zvalid_suffixesr+r+r,_detect_file_types$     rremove_finishedc Cst|\}}}|std|d|dur'tt|||dur#|nd}t|}||d$}t|d}| | Wdn1sHwYWdn1sWwY|rct |t|S)aDecompress a file. The compression is automatically detected from the file name. Args: from_path (str): Path to the file to be decompressed. to_path (str): Path to the decompressed file. If omitted, ``from_path`` without compression extension is used. remove_finished (bool): If ``True``, remove the file after the extraction. Returns: (str): Path to the decompressed file. z*Couldn't detect a compression from suffix rENr3r) rrbrrr>rZrarr"r%r$remove) rrrrv archive_typerZcompressed_file_openerZrfhZwfhr+r+r, _decompress%s$  rc sdtjdtttjfffdd }|durtj}t\}}}|srZ)rrr+r, path_or_str]s  z$extract_archive..path_or_strNr)r)rrr rr>r?dirnamerrr[rYrarr) rrrrrvrrrZ extractorr+rr,extract_archiveIs "   r download_root extract_rootcCsTtj|}|dur |}|stj|}t||||tj||}t|||dSr<)r>r?rXrYrer[r)rrrrr7rarchiver+r+r,download_and_extract_archiveys  riterablecCsdddd|DdS)N'z', 'cSsg|]}t|qSr+)r)riitemr+r+r,rlsz#iterable_to_str..)r[)rr+r+r,iterable_to_strsrTvaluearg valid_values custom_msgcCst|ts|dur d}nd}|jt||d}t||dur!|S||vr?|dur/|}t|d}|j||t|d}t||S)Nz'Expected type str, but got type {type}.z:Expected type str for argument {arg}, but got type {type}.)typerzPUnknown value '{value}' for argument {arg}. Valid values are {{{valid_values}}}.)rrr)rrformatr ValueErrorr)rrrrmsgr+r+r,verify_str_args r file_nameslice_channelsc Cst|dL}|}|dvrtdtd|}|s"tddd|D\}}t|}|dkr?d }| }nd }t j ||d d } Wd n1sTwY|dkr_dnd} | |||  ddd} t j | dd} | d |d d d d f} | t jS)aDRead file in .pfm format. Might contain either 1 or 3 channels of data. Args: file_name (str): Path to the file. slice_channels (int): Number of channels to slice out of the file. Useful for reading different data formats stored in .pfm files: Optical Flows, Stereo Disparity Maps, etc. r3)PFsPfzInvalid PFM files^(\d+)\s(\d+)\s$zMalformed PFM header.css|]}t|VqdSr<)int)ridimr+r+r, sz_read_pfm..r<>r9)dtypeNrr0rDr)Zaxis)r"readlinerstriprrKrL ExceptiongroupsfloatnpfromfileZreshapeZ transposeflipZastypeZfloat32) rrr9headerZ dim_matchwhscaleZendiandataZ pfm_channelsr+r+r, _read_pfms(  rtcCsN|tjjg|j|Rdjg|jdddR|jS)Nr) contiguousviewtorchZuint8shapeZ element_sizerr)rr+r+r,_flip_byte_ordersLr)r)r.r<)r0)NNr0)F)NN)NF)NNNF)NNN)r)Hbz2gzipr6lzmar>Zos.pathrrKr4rr urllib.errorurllib.requestrtypingrrrrrrrr r r urllib.parser numpyrrZtorch.utils.model_zoor Z_internally_replaced_utilsrrr!rrrr-r:boolr=rArIrPrerurzr]r ZIP_BZIP2ZIP_LZMAr__annotations__rrr"rrrrrrrbytesrrZndarrayrZTensorrr+r+r+r,s( 0  &"$&  &5*  %       <&.-  &   3     $$