A personal open source implementation of Transformers (original paper: here) in Tensorflow 2 with some improvements found by researchers (sometimes updated).
Created in 07/2021 by Valentin Goldité (github:valentingol)
Install the dependencies in a new python virtual environment:
pip install -r requirements.txt