Finetune BERT for Text Classifier

Goal

I made this project to get used with using transformer module for finetune model easily.
Learn how to write a code for finetune BERT for Text Classification Task.


Overview of BERT


How BERT Tokenizer work


Requirements

  • transformers
  • pytorch
  • numpy
  • pandas

How to run

$ python train.py --lr 1e-6 --epochs 5

Reference