https://docs.vllm.ai/en/latest/getting_started/v1_user_guide.html#logprobs
Would it be possible to have a request parameter for the api return logprobs?
Please authenticate to join the conversation.
Backlog
API
API
10 months ago

An Anonymous User
Get notified by email when there are changes.
Backlog
API
API
10 months ago

An Anonymous User
Get notified by email when there are changes.