CE7455--Roberta-Text-Classification

CE7455 - Final Project

Yeo Wei Jie, Lin YuKun, Luqman Alka

Fine-tuning Roberta on text classification task

6 google colab notebooks

  • 6_class_emotion_TF - results of evaluation on 6-class emotion dataset with Transfer learning applied on SST-2 and 4-class Emotion dataset
  • Roberta_optimization_fine_tuning - results of applying Raytune on optimizer choice between Adam, AdamW and SGD
  • Emotion_dataset_Raytune - Evaluation on 4-class emotion dataset with individual as well as overall HP fine-tuning
  • Finetuning Optuna - Hyperparameter space exploration using Optuna on 4-class emotion dataset and custom BPE tokenizer creation and model training
  • SST2-HP- HP fine-tuning
  • SST2_baseline - Baseline result of SST2