feature: token/credit limits
joaomendoncaa opened this issue · 0 comments
joaomendoncaa commented
Feature request
I would love if we could somehow see the remaining tokens / credits (regardless of the unit-of-account,) for the currently selected model. This would probably only be achievable on a case-by-case basis depending if the provider gives that information on its API.
Ideally that information could exist bellow the already existing list at the top.
I've seen that there's a glimpse of hope in Anthropic's API, would love if someone could chime in. If this sounds interesting enough (and feasable,) I can integrate it in Avante.
https://docs.anthropic.com/en/api/rate-limits#response-headers
Motivation
No response
Other
No response