SamsungLabs/SummaryMixing
This repository implements SummaryMixing, a simpler, faster and much cheaper replacement to self-attention for automatic speech recognition (see: https://arxiv.org/abs/2307.07421). The code is ready to be used with the SpeechBrain toolkit).
PythonNOASSERTION
Issues
- 3
Issue Encoder-only SummaryMixing
#5 opened by Adel-Moumen - 4
Valid step generates a RuntimeError
#8 opened by Craya - 5
The grad norm is nan
#4 opened by sister-tong