Response logprobs output

https://docs.vllm.ai/en/latest/getting_started/v1_user_guide.html#logprobs

Would it be possible to have a request parameter for the api return logprobs?

Please authenticate to join the conversation.

Upvoters
Status

Backlog

Board

API

Tags

API

Date

10 months ago

Author

An Anonymous User

Subscribe to post

Get notified by email when there are changes.