o òh¤ã@sRddlmZddlmZeGdd„dƒƒZeeeeefZeeeefZ dS)é)Ú dataclass)ÚOptionalc@s:eZdZUdZeed<dZeeed<dZ ee ed<dS)ÚLogprobzìInfos for supporting OpenAI compatible logprobs and token ranks. Attributes: logprob: The logprob of chosen token rank: The vocab rank of chosen token (>=1) decoded_token: The decoded chosen token index ZlogprobNÚrankÚ decoded_token) Ú__name__Ú __module__Ú __qualname__Ú__doc__ÚfloatÚ__annotations__rrÚintrÚstr©rrú8/usr/local/lib/python3.10/site-packages/vllm/logprobs.pyr s rN) Ú dataclassesrÚtypingrrÚlistÚdictr ZPromptLogprobsZSampleLogprobsrrrrÚs