Rishit-dagli/Nystromformer
An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention
PythonApache-2.0
Issues
- 0
Minimalistic Documentation
#9 opened by Rishit-dagli - 0
Unit tests
#7 opened by Rishit-dagli - 0
Automate publishing library
#8 opened by Rishit-dagli - 0
Add GitHub specific files
#10 opened by Rishit-dagli - 0
Linting
#11 opened by Rishit-dagli - 0
Package setup
#15 opened by Rishit-dagli - 0
Put together a Nystromformer
#5 opened by Rishit-dagli - 1
Feed Forward layers
#4 opened by Rishit-dagli - 0
Implement GELU activation
#6 opened by Rishit-dagli - 0
Normalization layers
#3 opened by Rishit-dagli - 1
Implement Nyström Attention
#2 opened by Rishit-dagli - 1
Implement Moore Penrose Pseudoinverse
#1 opened by Rishit-dagli