o 0 i@sdZddlmZmZmZmZddlmZddlm Z m Z ddl m Z ddl mZmZmZddlmZmZmZdd lmZmZdd lmZd d ZGd dde ZGdddeZdS)zbThis is an experimental tool for reconstructing text from a shaped tree, based on a Lark grammar. )DictCallableIterableOptional)Lark)Tree ParseTree)Transformer_InPlace)Token PatternStr TerminalDef)Terminal NonTerminalSymbol) TreeMatcheris_discarded_terminal)is_id_continuecCs$zt|}WdStyYdSw)NFT)next StopIteration)i_r\/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/lark/reconstruct.py is_iter_emptys  rc@steZdZUdZeeefed<eeee geffed<deeefdeeee geffddfddZ dd Z dS) WriteTokensTransformerzTInserts discarded tokens into their correct place, according to the rules of grammartokens term_subsreturnNcCs||_||_dSN)rr)selfrrrrr__init__s zWriteTokensTransformer.__init__c Cst|dds t||St|}g}|jD]g}t|rJz |j|j|}WntyC|j|j}t |j t s=t d||j j }Ynw||qt|} t | trX|| 7}qt | trit| j|kshJ| n t| j|ksvJ|| f|| qt|sJ|S)N match_treeFz,Reconstructing regexps not supported yet: %s)getattrriterZorig_expansionrrnameKeyErrorr isinstancepatternr NotImplementedErrorvalueappendrlistr rtyperdatar) r r.childrenmetaZ iter_argsZto_writesymvtxrrr __default__!s0              z"WriteTokensTransformer.__default__) __name__ __module__ __qualname____doc__rstrr __annotations__rrr!r5rrrrrs 0 rc @seZdZUdZeed<ddedeee e e ge ffddfddZ d d Z dd ed ee ee gee fdede fddZdS) Reconstructora A Reconstructor that will, given a full parse Tree, generate source code. Note: The reconstructor cannot generate values from regexps. If you need to produce discarded regexes, such as newlines, use `term_subs` and provide default values for them. Parameters: parser: a Lark instance term_subs: a dictionary of [Terminal name as str] to [output text as str] write_tokensNparserrrcCs,t||tdd|jD|pi|_dS)NcSsi|]}|j|qSr)r%).0r3rrr Ssz*Reconstructor.__init__..)rr!rrr=)r r>rrrrr!Ps  zReconstructor.__init__ccsL|||j}|j|}|D]}t|tr ||EdHq|VqdSr)r"r.r=Z transformr'r _reconstruct)r treeZunreduced_treeresitemrrrrAUs  zReconstructor._reconstructTrBpostproc insert_spacescCsn||}|r ||}g}d}|D] }|r*|r*|r*t|dr*t|dr*|d|||}qd|S)Nr )rArr+join)r rBrErFr4yZ prev_itemrDrrr reconstruct`s $   zReconstructor.reconstructr)NT)r6r7r8r9rr;rrrr:rrr!rAr rboolrLrrrrr<As  .6 r<N)r9typingrrrrZlarkrrBrr Zvisitorsr lexerr r r ZgrammarrrrZ tree_matcherrrutilsrrrr<rrrrs   *