Method to set default values for API

Pretty much that. It would be useful to have an option at the API dashboard (and an API endpoint) to be able to set per-model or global (per-model having priority over global) settings like sampling options (temperature, top_p, etc), reasoning settings and venice parameters (especially include_venice_system_prompt).

Please authenticate to join the conversation.

Upvoters
Status

New Submission

Board
💡

Feature Requests

Tags

API

Date

About 1 month ago

Author

New dot

Subscribe to post

Get notified by email when there are changes.