/gpt2-estimator

A tf.estimator version of GPT2

Primary LanguagePythonMIT LicenseMIT

GPT2-Estimator

What is this project?

An implementation of GPT2 using the tf.estimator API. Now GPT2 training can be run with Multiple GPUs!

Why would I need this?

  • Easier training and inference
  • Train on multiple GPUs
  • All the goodies that tf.estimator provides
  • TF 2.0 compatible

Reference: