o `+ i@sJddlmZddlZddlZddlmZmZddlmZGdddZ dS)) annotationsN)AnyOptional)DocumentcseZdZUdZdZded< dZded< d1d2fd d Zed3ddZ ed4ddZ d5ddZ  d6d7dd Z !d8d9d%d&Z ! 'd:d;d)d*Z ! ' dRecursiveJsonSplitteraSplits JSON data into smaller, structured chunks while preserving hierarchy. This class provides methods to split JSON data into smaller dictionaries or JSON-formatted strings based on configurable maximum and minimum chunk sizes. It supports nested JSON structures, optionally converts lists into dictionaries for better chunking, and allows the creation of document objects for further use. intmax_chunk_sizeimin_chunk_sizeN Optional[int]returnNonecs6t||_|dur||_dSt|dd|_dS)aInitialize the chunk size configuration for text processing. This constructor sets up the maximum and minimum chunk sizes, ensuring that the ``min_chunk_size`` defaults to a value slightly smaller than the ``max_chunk_size`` if not explicitly provided. Args: max_chunk_size: The maximum size for a chunk. Defaults to 2000. min_chunk_size: The minimum size for a chunk. If None, defaults to the maximum chunk size minus 200, with a lower bound of 50. N2)super__init__r maxr )selfr r  __class__i/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/langchain_text_splitters/json.pyrs  zRecursiveJsonSplitter.__init__datadict[str, Any]cCstt|S)z1Calculate the size of the serialized JSON object.)lenjsondumps)rrrr _json_size/sz RecursiveJsonSplitter._json_sizedpath list[str]valuercCs.|ddD]}||i}q|||d<dS)z;Set a value in a nested dictionary based on the given path.N) setdefault)rrr!keyrrr_set_nested_dict4sz&RecursiveJsonSplitter._set_nested_dictcsDt|trfdd|DSt|tr fddt|DS|S)Ncsi|] \}}||qSr)_list_to_dict_preprocessing).0kvrrr >szERecursiveJsonSplitter._list_to_dict_preprocessing..cs i|] \}}t||qSr)strr&)r'iitemr*rrr+As) isinstancedictitemslist enumerate)rrrr*rr&;s   z1RecursiveJsonSplitter._list_to_dict_preprocessing current_pathOptional[list[str]]chunksOptional[list[dict[str, Any]]]list[dict[str, Any]]c Cs|pg}|dur |nig}t|trU|D]<\}}g||}||d}|||i}|j|} || krA||d||q||jkrK|i||||q|S||d|||S)zESplit json into maximum size dictionaries while preserving structure.Nr") r/r0r1rr r%r append _json_split) rrr4r6r$r!new_path chunk_sizesize remainingrrrr:Hs      z!RecursiveJsonSplitter._json_splitF json_data convert_listsboolcCs4|r |||}n||}|ds||S)z'Splits JSON into a list of JSON chunks.r")r:r&pop)rr?r@r6rrr split_jsongs  z RecursiveJsonSplitter.split_jsonT ensure_asciics |j||d}fdd|DS)z2Splits JSON into a list of JSON formatted strings.)r?r@csg|] }tj|dqS)rD)rr)r'chunkrErr sz4RecursiveJsonSplitter.split_text..)rC)rr?r@rDr6rrEr split_textwsz RecursiveJsonSplitter.split_texttexts metadatasOptional[list[dict[Any, Any]]]list[Document]c Csf|pigt|}g}t|D]!\}}|j|||dD]} t||} t| | d} || qq|S)z4Create documents from a list of json objects (Dict).)r?r@rD)Z page_contentmetadata)rr3rHcopydeepcopyrr9) rrIr@rDrJZ _metadatasZ documentsr-textrFrMZnew_docrrrcreate_documentss   z&RecursiveJsonSplitter.create_documents)rN)r rr r r r )rrr r)rrrr r!rr r )rrr r)NN)rrr4r5r6r7r r8)F)r?rr@rAr r8)FT)r?rr@rArDrAr r )FTN) rIr8r@rArDrArJrKr rL)__name__ __module__ __qualname____doc__r __annotations__r r staticmethodrr%r&r:rCrHrQ __classcell__rrrrr s2       "  r) __future__rrNrtypingrrZlangchain_core.documentsrrrrrrs