Transformers vs LTSM & CNN/RNN for Attention

[Nostrademous]

https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf

[Nostrademous]

Interesting implementation here: http://nlp.seas.harvard.edu/2018/04/03/attention.html