Response logprobs output
https://docs.vllm.ai/en/latest/getting_started/v1_user_guide.html#logprobs
Would it be possible to have a request parameter for the api return logprobs?
Status: Backlog
https://docs.vllm.ai/en/latest/getting_started/v1_user_guide.html#logprobs
Would it be possible to have a request parameter for the api return logprobs?
Log in to comment and vote
No comments yet
Be the first to share your thoughts.