o )i@sddlZddlmZddlmZmZdejdejdejdejdejd eeed ejfd d Z d eeed edej d ejfddZ dS)N)apply_penalties)is_pin_memory_availablemake_tensor_with_padlogitsprompt_token_idspresence_penaltiesfrequency_penaltiesrepetition_penaltiesoutput_token_idsreturnc Cs*|j\}}t|||j}t||||||S)zM Applies presence, frequency and repetition penalties to the logits. )shape_convert_to_tensorsdevicer) rrrrr r _ vocab_sizeZoutput_tokens_trh/home/app/PaddleOCR-VL-test/.venv_paddleocr/lib/python3.10/site-packages/vllm/v1/sample/ops/penalties.pyapply_all_penalties s rrrcCs$t||dtjtd}|j|ddS)z@ Convert the different list data structures to tensors. cpu)padrZdtypeZ pin_memoryT)Z non_blocking)rtorchZint64rto)r rrZoutput_tokens_tensorrrrr s r ) rZ vllm.model_executor.layers.utilsrZ vllm.utilsrrZTensorlistintrrr rrrrs.