/ASR-Conformer

Conformer: Convolution-augmented Transformer for Speech Recognition

Primary LanguagePython

Paper:https://arxiv.org/abs/2005.08100

Model

- Encoder

0

Conv Module c

Attention Module f

FFN Module e

Update

Conformer 에서는 Decoder로 LSTM만 사용

=> Decoder 에 ASR-Transformer Decoder 추가

Reference

lite transformer with long-short range attention : https://arxiv.org/abs/2004.11886

specAugment :https://arxiv.org/abs/1904.08779

Multi-head attention with relative pos encoding :https://arxiv.org/abs/1901.02860

https://github.com/lucidrains/conformer

https://github.com/sooftware/conformer

Dataset

clovacall: https://github.com/clovaai/ClovaCall

Ai_hub(1,000 hours)