google-research/xtreme

Cannot achieve the XNLI performance in the paper

Mingqi7 opened this issue · 0 comments

Mingqi7 commented

Hi,

I use the code to fine-tune mBERT on MultiNLI and evaluate on fr and de, but after 2 epochs(batch_size=32, lr=2e-5), the accuracy is still around 40%, do you have any idea to fix this?