linformer
There are 4 repositories under linformer topic.
Separius/awesome-fast-attention
list of efficient attention modules
tatp22/linformer-pytorch
My take on a practical implementation of Linformer for Pytorch.
kuixu/Linear-Multihead-Attention
Reproducing the Linear Multihead Attention introduced in Linformer paper (Linformer: Self-Attention with Linear Complexity)
pranavphoenix/VisionXformer
Vision Xformers