sooftware/conformer

Example of how to train conformer

CSLujunyu opened this issue · 6 comments

Hello, thanks for sharing this nice project. Could you provide some example on how to train conformer model with rnnt loss?

Sooner or later, a library will be unveiled to train multiple models, including the conformer transducer. I intend to release it as early as this week. I'll leave a comment here after I reveal it.

Will this solve this issue I had here sooftware/kospeech#119 ?

@mjurkus I think you should -1 at target_lengths like target_lengths -= 1

I'm now implementing the code with pytorch lightning, practically completing it and fixing it while looking for bugs. I think it would be a good reference for you.

Amazing! I also used Pytorch Lightning. Everything worked except that part. I'll look into your suggestion regarding target_lengths

@mjurkus @CSLujunyu I release new library openspeech. This repo contains conformed training.