Support AI Subscription based ratelimit
Closed this issue · 1 comments
Tharsanan1 commented
Problem
We are introducing AI APIs to apk. In the AI usecases its a common usecase to limit the requests based on the token counts(prompt, completion, total).
Solution
Add a feature to support subscription scoped ratelimiting AI requests based on the token count.
Affected Component
None
Version
No response
Implementation
No response
Related Issues
No response
Suggested Labels
No response
Tharsanan1 commented
Feature added with : #2446