pytorch-attention
There are 2 repositories under pytorch-attention topic.
pprp/awesome-attention-mechanism-in-cv
Awesome List of Attention Modules and Plug&Play Modules in Computer Vision
sakuranew/attention-pytorch
pytorch实现的基于attention is all your need提出的Q,K,V的attention模板和派生的attention实现。