/GPT-finetuning

Code for finetuning GPT models and its variants for text data

Primary LanguagePythonMIT LicenseMIT

GPT-finetuning

Code for finetuning GPT models and its variants for text data in Tensorflow

Text dataset is saved in the same directory as 'data_input.txt'

The model used : GPT-2

Packages used:

  • Tensorflow
  • Transformers

Note:

  • Maximum tokens : 1024
  • Model : GPT LMHead Model