/TransfoTF

A personal open source implementation of transformers in Tensorflow 2 with some improvements found on the Internet (sometimes updated). Created in 07/2021 by Valentin Goldité

Primary LanguagePythonMIT LicenseMIT

Transformers in Tensorflow 2

A personal open source implementation of Transformers (original paper: here) in Tensorflow 2 with some improvements found by researchers (sometimes updated).

Created in 07/2021 by Valentin Goldité (github:valentingol)

alt text

Quick start

Install the dependencies in a new python virtual environment:

pip install -r requirements.txt