o i*I @sdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z mZddlmZddlmZmZmZmZmZmZmZddlmZddlmZerrdd lmZdd lm Z dd l!m"Z"dd l#m$Z$ed Z%ede&dZ'ee'e(fZ)e*e+Z,GdddeZ-de-fddZ.de/ee(ffddZ0de ee%de1e%fddZ2dee3e(fde(fddZ4ddde5ee3e(fefd e6de5e(effd!d"Z7d#Z8d$ede(fd%d&Z9d'e(ded(effd)d*Z:d'e(de;d+fd,d-Zd4e(de(fd5d6Z?d7e(de(fd8d9Z@dejfd:d;ZAdd?ZCd@e(dejfdAdBZDdCede6fdDdEZEedCe(de1e(fdFdGZFedCd.de1d.fdHdGZFedCed.e(eed.e(ffde1ed.e(ffdIdGZFedCe e'de1e'fdJdGZFedCe'de1e'fdKdGZFdLdGZFdeGfdMdNZHdrde;fdOdPZIdQee3e(fdejfdRdSZJdTeeeGeKe(fdeeGfdUdVZLdWdXde/eGeGeGffdYdZZMd[d\ZNd]ee%d^eGde ee%ddffd_d`ZOdrdae(dbeeGde(fdcddZP drdeee(dfedge5eefdbeeGdee(f dhdiZQdje ee(d1fde1e(fdkdlZRdje ee(d1fdedXfdmdnZSdoe(de/e(e(ffdpdqZTdS)sz Miscellaneous helper functions. The formatter for ANSI colored console output is heavily based on Pygments terminal colorizing code, originally by Georg Brandl. N) GeneratorIterableSequence)Enum) TYPE_CHECKINGAnyCallableOptionalTypeVarUnionoverload) ResponseError)TimeoutFormatError)RedisJobQueue BaseWorker_T_O)boundc@s eZdZdZdZdZdZdZdS)Platformz0Enum representing the operating system platform.windowsmaclinuxZothersN)__name__ __module__ __qualname____doc__WINDOWSMACLINUXOTHERSr&r&?/home/app/Keep/.python/lib/python3.10/site-packages/rq/utils.pyr4s rreturncCs>tj}|dr tjS|dkrtjS|drtjStjS)aCDetect and return the current operating system platform. Returns: Platform: The detected platform enum value. - Platform.WINDOWS for Windows systems - Platform.MAC for macOS systems - Platform.LINUX for Linux systems - Platform.OTHERS for any other platform windarwinr) sysplatformlower startswithrr"r#r$r%)r,r&r&r' get_platform=s  r/cCst|r |j|jfSt|st|r d|jd|jfSt|t r+dt |fSt |s9t |dr9|dfSt d|)aResolve a function reference into instance and function name components. Args: func: The function reference to resolve - can be a method, function, builtin, string path, or callable class instance. Returns: A tuple of (instance, func_name) where: - instance: The object instance (for methods/callable instances) or None - func_name: The string representation of the function name/path Raises: TypeError: If func is not a valid callable or string reference. N.__call__z*Expected a callable or a string, but got: )inspectismethod__self__r isfunction isbuiltinrr isinstancestras_textisclasshasattr TypeError)funcr&r&r'resolve_function_referenceSs    r>lstcCsdd|DS)zExcludes `None` values from a list-like object. Args: lst (list): A list (or list-like) object Returns: object (list): The list without None values cSsg|]}|dur|qSNr&).0itemr&r&r' wszcompact..r&)r?r&r&r'compactns rDvcCs4t|tr |dSt|tr|Stdt|)zConverts a bytes value to a string using `utf-8`. Args: v (Union[bytes, str]): The value (bytes or string) Raises: ValueError: If the value is not bytes or string Returns: value (str): The decoded string zutf-8z Unknown type )r7bytesdecoder8 ValueErrortype)rEr&r&r'r9zs  r9F) decode_valueshrJcCs(|r dd|DSdd|DS)aDecodes the Redis hash, ensuring that keys are strings Most importantly, decodes bytes strings, ensuring the dict has str keys. Args: h (Dict[Any, Any]): The Redis hash decode_values (bool): If True, also decode values to strings using as_text(). Defaults to False. Returns: Dict[str, Any]: The decoded Redis data (Dictionary) When decode_values=True, returns Dict[str, str] cSsi|] \}}t|t|qSr&r9rAkrEr&r&r' z%decode_redis_hash..cSsi|] \}}t||qSr&rLrMr&r&r'rOs)items)rKrJr&r&r'decode_redis_hashs rRzvaluec Cs(zt|WSttfytYSw)zCReturn JSON string if serializable, otherwise a placeholder string.)jsondumpsr<rHNOT_JSON_SERIALIZABLE)rSr&r&r'safe_json_dumpss  rWname.c Cs|d}|dd|dg}}d}t|r9z d|}t|}Wnty4|d|Ynwt|s|durQzt|WSt yPt d|wd|}t ||r`t ||S|}d|}zt ||}Wn t d|t ||st d|t ||S)a#Returns an attribute from a dotted path name. Example: `path.to.func`. When the attribute we look for is a staticmethod, module name in its dotted path is not the last-before-end word E.g.: package_a.package_b.module_a.ClassA.my_static_method Thus we remove the bits from the end of the name until we can import it Args: name (str): The name (reference) to the path. Raises: ValueError: If no module is found or invalid attribute name. Returns: Any: An attribute (normally a Callable) r0NrzInvalid attribute name: ) splitlenjoin importlib import_module ImportErrorinsertpop __builtins__KeyErrorrHr;getattr) rXZ name_bitsZmodule_name_bitsZattribute_bitsmodule module_nameZattribute_nameZattribute_owner_nameZattribute_ownerr&r&r'import_attributes<            rgrcCHt|}t|tstd|ddlm}t||s"td||S)z.Import a worker class from a dotted path name.zInvalid worker class: rr)rgr7rIrHworkerr issubclass)rXclsrr&r&r'import_worker_class   rlrcCrh)z+Import a job class from a dotted path name.zInvalid job class: rr)rgr7rIrHjobrrj)rXrkrr&r&r'import_job_classrmrorcCrh)z-Import a queue class from a dotted path name.zInvalid queue class: rr)rgr7rIrHqueuerrj)rXrkrr&r&r'import_queue_classrmrq config_pathcCsftjj|vp |d}|s|S|}|dr|dd}|tjjr)|dd}|tjjd}|S)a"Normalize configuration path to dotted module path format. Converts file paths like 'directory/config_file.py' or 'directory.config_file' to dotted module paths like 'directory.config_file' for use with importlib.import_module(). Args: config_path: Either a file path (e.g., 'app/cron_config.py', 'app/cron_config') or a dotted module path (e.g., 'app.cron_config') Returns: A dotted module path suitable for importlib.import_module() Examples: normalize_config_path('app/cron_config.py') -> 'app.cron_config' normalize_config_path('app/cron_config') -> 'app.cron_config' normalize_config_path('app.cron_config') -> 'app.cron_config' normalize_config_path('/abs/path/to/config.py') -> 'abs.path.to.config' z.pyNrr0)ospathsependswithr.replace)rrZ is_file_path normalizedr&r&r'normalize_config_path s   rz file_pathcCs<tj|std|dtj|std|d|S)amValidate that an absolute file path exists and points to a file. Args: file_path: The absolute file path to validate Returns: The same file path if validation passes (for chaining) Raises: FileNotFoundError: If the file does not exist IsADirectoryError: If the path points to a directory instead of a file Examples: validate_absolute_path('/path/to/config.py') # Returns '/path/to/config.py' validate_absolute_path('/path/to/missing.py') # Raises FileNotFoundError validate_absolute_path('/path/to/directory') # Raises IsADirectoryError z!Configuration file not found at ''z7Configuration path points to a directory, not a file: ')rtruexistsFileNotFoundErrorisfileIsADirectoryError)r{r&r&r'validate_absolute_path7s  rcCstjtjjS)zReturn now in UTC)datetimenowtimezoneutcr&r&r&r'rRsrz%Y-%m-%dT%H:%M:%S.%fZdtcCs|ttSr@)strftimer9_TIMESTAMP_FORMAT)rr&r&r' utcformatZsrstringcCsDz tj|t}Wntytj|d}Ynw|jtjjdS)Nz%Y-%m-%dT%H:%M:%SZ)tzinfo)rstrptimerrHrxrr)rparsedr&r&r'utcparse^s  robjcCst|to t|t S)zReturns whether the obj is an iterable, but not a string Args: obj (Any): _description_ Returns: bool: _description_ )r7rr8rr&r&r'is_nonstring_iterablegs rcCdSr@r&rr&r&r'ensure_job_listsrcCrr@r&rr&r&r'rurcCrr@r&rr&r&r'rwrcCrr@r&rr&r&r'ryrcCrr@r&rr&r&r'r{rcCs"t|trt|tst|S|gS)zWhen passed an iterable of objects, convert to list, otherwise, it returns a list with just that object in it. Args: obj (Any): _description_ returns: List: _description_ )r7rr8listrr&r&r'rs" cCsttS)zKReturns current UTC timestamp Returns: int: _description_ )calendartimegmr utctimetupler&r&r&r'current_timestampsrcCs(|dur t||St|trt|S|S)aGet a backend class using its default attribute name or an override Args: holder (_type_): _description_ default_name (_type_): _description_ override (_type_, optional): _description_. Defaults to None. Returns: _type_: _description_ N)rdr7r8rg)Zholder default_nameoverrider&r&r' backend_classs   rdate_strcCs*|stdt|trt|St|S)Nz#Empty string or bytestring provided)rHr7rFrrG)rr&r&r' str_to_dates   rtimeoutc Cst|tjsP|durPzt|}|WStyOt|tsJ|dd|dd}}ddddd}z t|||}Wn ttfyLtdwYnw|durXt|SdS) zGTransfer all kinds of timeout format to an integer representing secondsNrYiQi<r)drKmszTimeout must be an integer or a string representing an integer, or a string with format: digits + unit, unit can be "d", "h", "m", "s", such as "1h", "23m".) r7numbersIntegralintrHr8r-rcr)rdigitunitZ unit_secondr&r&r' parse_timeouts$  r connectionrcCsz.r0r)r ) rdr8inforZr[appendsetattrtupler )r version_str version_partsr&r&r' get_versions       rcCs | | S)zCeiling division. Returns the ceiling of the quotient of a division operation Args: a (_type_): _description_ b (_type_): _description_ Returns: _type_: _description_ r&)abr&r&r'ceildivs ra_list segment_sizeccs.tdt||D] }||||Vq dS)zSplits a list into multiple smaller lists having size `segment_size` Args: a_list (Sequence[Any]): A sequence to split segment_size (int): The segment size to split into Yields: list: The splitted listed rN)ranger[)rrrr&r&r' split_lists rdata max_lengthcCs,|dur|St||kr|d|dS|S)aTruncate arguments with representation longer than max_length Args: data (str): The data to truncate max_length (Optional[int], optional): The max length. Defaults to None. Returns: truncated (str): The truncated string Nz...)r[)rrr&r&r'truncate_long_strings  r func_nameargskwargscsZ|durdSfdd|D}fdd|D}|t|7}d|}|d|dS)a Returns a string representation of the call, formatted as a regular Python function invocation statement. If max_length is not None, truncate arguments with representation longer than max_length. Args: func_name (str): The function name args (Any): The function arguments kwargs (Dict[Any, Any]): The function kwargs max_length (int, optional): The max length. Defaults to None. Returns: str: A string representation of the function call. Ncsg|] }ttt|qSr&r9rrepr)rAargrr&r'rC&rPz#get_call_string..cs,g|]\}}|dttt|qS)=rrMrr&r'rC(s,z, ())rQsortedr\)rrrrarg_listZ list_kwargsr&rr'get_call_strings  rqueues_or_namescCsDddlm}g}|D]}t||r||jq |t|q |S)z;Given a iterable of strings or queues, returns queue namesrr)rprr7rrXr8)rrnames queue_or_namer&r&r' parse_names/s  rcCs.ddlm}|D] }t||r|jSqdS)z7Given a list of strings or queues, returns a connectionrrN)rprr7r)rrrr&r&r'get_connection_from_queues<s   r composite_keycCsD|d}t|dkrtd|t|ddfS|\}}||fS)zMethod returns a parsed composite key. Args: composite_key (str): the composite key to parse Returns: tuple[str, str]: tuple of job id and the execution id :rz4Composite key must contain job_id:execution_id, got r)rZr[warningswarnDeprecationWarning)rresultZjob_idZ execution_idr&r&r'parse_composite_keyFs  rr@)Ur!rrr]r2rTloggingrrtr+rcollections.abcrrrenumrtypingrrrr r r r Zredis.exceptionsr exceptionsrZredisrrnrrprrirrobjectrr8ZObjOrStr getLoggerrloggerrr/rr>rrDrFr9dictboolrRrVrWrgrIrlrorqrzrrrrrrrrrrrfloatrrrrrrrrrr&r&r&r's $          45+  6 $ (   ""