Unified Orchestrator Layer

We need a centralized interface that seamlessly transitions between different available models without memory loss. Venice should be able to swap models on the fly to suit user needs without forgetting what it was doing to be begin with. Long term, this will be a necessity for this service as it's basically going to be standard amongst other potential services like this. 

Please authenticate to join the conversation.

Upvoters
Status

Backlog

Board
💡

Feature Requests

Tags

Chat

Date

7 months ago

Author

backsweat

Subscribe to post

Get notified by email when there are changes.