The goal of the repository is to provide a clean and simple implementation of the attention mechanisms in the wild. Test the public implementations and benchmark the performance differences, and see how they can be improved.
vaibhavk97/Attention
Clean and Simple Reference implementations for different attention mechanisms
Python