quic/ai-hub-models

[Feature Request] Whisper Small.En Quantized

Carl-2008 opened this issue · 2 comments

Carl-2008 commented

How to export Whisper small.En quantization model?
For example, the int8 quantified version .

mestrona-3 commented

Hi @Carl-2008, we don't have a quantized version of Whisper on AI Hub Models currently. We have this on our backlog. We are also working on generic quantization recipes to share with our developer community. Stay tuned!

  • 👍1
Carl-2008 commented

Thanks, looking forward to it.