aalind0/Attention-is-All-You-Need

Implementation of the Transformer model from scratch.

Attention is All You Need

From scratch implementation of the famous Tranformer network model discussed in the paper "Attention is All You Need"

Link to paper

Some more interesting reads:

Deep Contextualized Word Representations (ELMos)