lilianweng/lilianweng.github.io

Add GAT to "Attention? Attention!" post

Opened this issue · 0 comments

First of all, thank you for your excellent blog. I needed clarification about attention models and their variants, and your post Attention? Attention! made it a lot clearer to me.

I recommend adding other attention models like graph attention (GAT & GATv2) to make the post more complete.