/multimodalSR

Multimodal speech recognition using lipreading (with CNNs) and audio (using LSTMs). Sensor fusion is done with an attention network.

Primary LanguageJupyter NotebookMIT LicenseMIT

Issues