Issues
- 0
- 0
Add grpc and graphql endpoints
#18 opened by ixaxaar - 0
- 0
Support OAUTH token introspection in APIs
#14 opened by ixaxaar - 0
Add K-V cache, more options for compilation
#13 opened by ixaxaar - 0
Add faster whisper for speech to text
#9 opened by ixaxaar - 0
- 0
Add whisper.cpp for speech to text
#10 opened by ixaxaar - 0
- 0
- 0
Implement streaming inference - audio
#3 opened by ixaxaar - 0
Implement batching for APIs - audio
#4 opened by ixaxaar - 0