/Finetune-QA

BERT, RoBERTa fine-tuning over SQuAD Dataset using pytorch-lightning⚡️, 🤗-transformers & 🤗-nlp.

Primary LanguagePython

SQUAD Fine-Tuning

BERT, RoBERTa fine-tuning over SQuAD Dataset using pytorch-lighting, transformers & nlp.

Example Usage: python main.py --gpus 1, --qa_model distilroberta-base --workers 20 --bs 5 --max_epochs 10

Install

pip install -r requirements.txt

Features

  • ⚡️Pytorch-Lightning: Goodies
    • All Trainer flags as args
    • Multi-GPU support
  • 🤗 Transformer: easy plug-n-play
  • 🤗 NLP Dataset: easy data handling

TODO: