Response logprobs output

https://docs.vllm.ai/en/latest/getting_started/v1_user_guide.html#logprobs

Would it be possible to have a request parameter for the api return logprobs?

Please authenticate to join the conversation.

Upvoters
Status

Backlog

Board

API

Tags

API

Date

About 1 year ago

Author

An Anonymous User

Subscribe to post

Get notified by email when there are changes.