Next Epoch remaining time to API Key Rate Limits
I am implementing various rate checks and slow downs to make sure not to use all allocated VCU or USD.
The logic tries to calculate application request rate based on remaining VCU or USD, but I am missing information how much time we have left until next epoch. i.e. "nextEpochBegins": "2025-06-01T00:00:00.000Z"
Currently we have set it to static time, but it would be really nice to have it in the API Key Rate Limits response to be able to calculate the application request rate limits dynamically.
Example:{
"data": {
"apiTier": {
"id": "paid",
"isCharged": true
},
"accessPermitted": true,
"keyExpiration": "2025-06-01T00:00:00.000Z",
"nextEpochBegins": "2025-06-01T00:00:00.000Z",
"balances": {
"VCU": 100.023,
"USD": 50.23
},
"rateLimits": [
{
"apiModelId": "llama-3.3-70b",
"rateLimits": [
{
"amount": 100,
"type": "RPM"
}
]
}
]
}
Log in to comment and vote
Comments2
JP
Mar 31, 2025
This should be released in the next 15-30 minutes.
Maroon Telescope
Mar 31, 2025
wow, thank you ;-)