IntelLabs/academic-budget-bert

Finetuning commands for other glue tasks

Opened this issue · 1 comments

HI,
Can you share what finetuning commands you used for other glue tasks? Did you use the same warmup, hyperparameters etc as for the example MRPC command you shared?

Authors have sweeped the parameters for the tasks (you can check Table 7 of the paper).

Hope it helps.