online speech recognition

Question

online speech recognition

Closed this issue 6 years ago · 7 comments

Hi,I have completed the training of the acoustic model. How can I use it for online speech recognition?look forward to your kind advice.

Answer 1 · 2019-02-25T03:38:20.000Z

The trained model is offline so it can not directly be used for online speech recognition. it requires the models to be trained with online CMN or something like that. Then use the kaldi-online decoder. You can find some online issues on kaldi
kaldi-asr/kaldi#2801

Answer 2 · 2019-02-25T17:10:25.000Z

The current version natively supports off-line speech recognition only. As outlined by @Rpersie working on on-line ASR requires different normalization and decoding strategies. We plan to support on-line ASR in one of the future version of the toolkit. <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> Virus-free. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

…

On Sun, 24 Feb 2019 at 22:38, Rpersie ***@***.***> wrote: The trained model is offline so it can not directly be used for online speech recognition. it requires the models to be trained with online CMN or something like that. Then use the kaldi-online decoder. You can find some online issues on kaldi kaldi-asr/kaldi#2801 <kaldi-asr/kaldi#2801> — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub <#56 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AQGs1iqs-QMhuXwanfY7m67Mri35sm_qks5vQ1qxgaJpZM4bPAmE> .

Answer 3 · 2019-02-26T02:57:23.000Z

thank you! Looking forward to your update！

Answer 4 · 2019-02-26T03:05:21.000Z

@Rpersie thank you!

Answer 5 · 2019-02-26T08:19:06.000Z

@mravanelli @Rpersie By the way, Why on-line ASR requires different normalization and decoding strategies? It requires faster decoding speed？

Answer 6 · 2019-02-26T08:29:26.000Z

As the offline cmvn is the mean and var of all frames，in the online mode you can not get all the frames. If you just do the online-cmvn, this will bring the mismatch between the training and test. As for decoding, the feats are loaded segments by segments in the online mode. So we should memory the wfst state of the previous segments. When the next segment is loaded, we can follow the wfst token states of previous. So the usual decoder can not be used and need online decoder.

Answer 7 · 2019-02-26T15:06:32.000Z

Yes, as outlined by @Rpersie the systems are different. In online ASR we start the decoding while recording the signal itself and we thus don't have access to the future. We will deal with it the the future!

…

On Tue, 26 Feb 2019 at 03:29, Rpersie ***@***.***> wrote: As the offline cmvn is the mean and var of all frames，in the online mode you can not get all the frames. If you just do the online-cmvn, this will bring the mismatch between the training and test. As for decoding, the feats are loaded segments by segments in the online mode. So we should memory the wfst state of the previous segments. When the next segment is loaded, we can follow the wfst token states of previous. So the usual decoder can not be used and need online decoder. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#56 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AQGs1jy2bdZhlptXvjFd1C3c0vEXubNeks5vRPBngaJpZM4bPAmE> .