fail to reproduce the experimental results from cited paper
Jiaxin-Wen opened this issue · 1 comments
Jiaxin-Wen commented
Hi, I tried to reproduce the experimental results of using BERT on the 1.7k imdb subset, which is reported in https://arxiv.org/pdf/1909.12434.pdf and also used in your paper.
However, I failed to reproduce either the in-distribution acc or the out-of-distribution acc. Specifically, I got a much higher acc.
Have you ever successfully reproduced this result?
lijiazheng99 commented
Hi,
Thanks for your interest in our work! We did reproduce the experiment. We cited their result to keep the same as the original work. I suggest you discuss this issue with the authors from the paper you mentioned.
Thanks!