Has CoLA changed?
davidefiocco opened this issue · 1 comments
davidefiocco commented
Hi! I have seen that CoLA has hit release 1.1 https://nyu-mll.github.io/CoLA/.
Are the changes documented anywhere? Is this expected to impact GLUE benchmarks in any significant way?
W4ngatang commented
Hi David,
We saw that CoLA changed but are still evaluating on the old version (using the data available on the GLUE site). We'll soon release SuperGLUE, which has mostly different tasks than GLUE.