ratwithacompiler/OBS-captions-plugin

Multilingual speech recognition

Siphonay opened this issue · 3 comments

Hello! I stream in English and French, both one or the other in one stream but there’s always a possibility that I utter a phrase in the other language e.g. to address someone in chat, or whatever, but when that happens, the caption come off as gibberish as they can only detect one language at a time.

In the documentation for Google Cloud’s speech recognition API, there is a mention of an alternativeLanguageCodes parameter to send to the request to detect additional languages: https://cloud.google.com/speech-to-text/docs/multiple-languages

Do you think this is something that could be integrated to the plug-in? It would absolutely be of great use for me and I’m sure many bilingual streamers.

I also do this French and English combo and it would be really nice

My understanding is that this plugin uses the "old" Cloud/Google STT, which lacks many of the new Cloud features (but also the cost).

Nixill commented

At the very least, it'd be nice to have support for a hotkey to switch between multiple languages on the fly.