ggerganov/whisper.cpp

Feature request - Support WhisperSpeech for voice generation with whisper model

LSXAxeller opened this issue · 2 comments

WhisperSpeech is a text-to-speech/voice generation/voice cloning model derived from OpenAI's Whisper model inversion. Integrating support for it into Whisper.cpp would enhance the functionality of whisper.cpp to cover all primary voice operations. can it be integrated ?
WhisperSpeech Repo

Thank you for mentioning:

Seems interesting. But I'm not sure if Georgi wouldn't prefer to have it as a separate project, e.g. whisperspeech.cpp. :)
Having both ASR and TTS in one project would be cool for sure, but it could make the maintenance harder, and maybe some tweaked version of whisper is needed there (don't know, as I haven't investigated it).

whisperspeech.cpp could be a nice alternative to: