It would be nice if the API could return Diem cost statistics. In particular, it would be nice if it would return the cost of a given API query.
I’m currently building an app with AI agents which will be powered by Venice. However, in order to improve the agents, I need to track the cost effectiveness of each model and system prompt for each agent role with random auditing.
Problem is, Venice doesn’t tell me the exact cost. There are two ways I have of estimating:
1) Do a heath check to get the Diem remaining, run the query, and subtract the Diem remaining from the prior health check.
This results in an unnecessary (albeit free) API call, so it works at face. However, if another API key (or my own Venice usage) calls a query at the same time, the costs will be summed resulting in an artificially expensive query.
2) Take the token usage model, etc, and manually estimate the usage myself. I have not had great luck with this perfectly mirroring the API usage at venice.AI suggesting it’s easy to miscalculate. Moreover, you are building very quickly, and when you introduce new features like web scraping and SERP, it screws up my prior formulas.
I think it would just be easier if Venice returned the total Diem consumption for every query.
Bonus points for letting us request more advanced analytics, but a simply cost per query would be nice. I’m assuming this could be added easily.
Please authenticate to join the conversation.
New Submission
API
API
2 months ago

privateuser
Get notified by email when there are changes.
New Submission
API
API
2 months ago

privateuser
Get notified by email when there are changes.