https://docs.vllm.ai/en/latest/getting_started/v1_user_guide.html#logprobs
Would it be possible to have a request parameter for the api return logprobs?
Please authenticate to join the conversation.
Backlog
API
API
About 1 year ago

An Anonymous User
Get notified by email when there are changes.
Backlog
API
API
About 1 year ago

An Anonymous User
Get notified by email when there are changes.