o 0 i] @sddlmZmZddlZddlmZddlmZm Z de de dee e ffd d Z de de deej fd d Z d eejdeej ddfddZd eejdeej ddfddZ ddedeej de ddfddZde deeee fdeej ddfddZdS))TupleListN)NDArray) LLMatcher LLExecutor batch_size vocab_sizereturncCs||ddfS)N rr r r \/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/llguidance/numpy.pyget_bitmask_shapesrcCstjt||dtjdS)Ndtype)npfullrint32rr r rallocate_token_bitmask s rlogitsmaskcCshtj|ddd}ttjdtjd|jd}||?d@}|ddd|jdf}tj ||dk<dS)Nr rZaxisrr)rrepeatZtileZarangershapeinf)rrZ mask_expandedZ bit_indicesZ bit_masksr r r"apply_token_bitmask_inplace_kernels  rcCs|jdkr tj|dd}|jdkrtj|dd}|jtjks"Jd|jdks+Jd|j\}}|j\}}||ks=Jdd|}||kr[tj |dd|df<|ddd|f}t||dS) NrrrMask must be int32zLogits must be 2DzBatch size mismatchr )ndimrZ expand_dimsrrrrr)rrbatchvocabZm_batchZm_vocabcutoffr r rapply_token_bitmask_inplaces    r%interpbitmaskindexcCsd|jtjks Jd|jdksJd||ddf}|jds$Jd||jj|j|j dS)Nrr Mask must be 2D C_CONTIGUOUSMask must be contiguous) rrrr!flagsunsafe_compute_mask_ptrctypesdatasizeitemsize)r&r'r(vr r rfill_next_token_bitmask/s r3executormatcherscCs^|jtjks Jd|jdksJd|j\}}|jds!Jd|||jj|d|dS)z Compute the token mask directly into the specified array. For each matcher, provide the index of the target mask. rr r)r*r+N) rrrr!rr,r-r.r/)r4r5r'r"r#r r rfill_next_token_bitmask_par9s  r7)r)typingrrnumpyrZ numpy.typingrZ_librrintrrrZfloat32rr%r3r7r r r rsF