Mewsli-X scripts

Question

Mewsli-X scripts

sumanthd17 opened this issue 3 years ago · 7 comments

Hi Guys,

Is it possible to get training and evaluation scripts for mewsli-X dataset? We are trying to reproduce the baseline results from the XTREME-R paper (Table 4), it would helpful for us if you can share the scripts used for training the models.

Thanks

Answer 1 · 2021-11-02T21:35:39.000Z

Hi @sumanthd17,

cc: @sebastianruder

Sorry for the delay here. We're working on hard to release the scripts for all the XTREME-R tasks. We hope to have this ready by the end of this month.

-- Melvin

Answer 2 · 2021-12-06T09:17:16.000Z

Hi @sumanthd17,

cc: @sebastianruder

Sorry for the delay here. We're working on hard to release the scripts for all the XTREME-R tasks. We hope to have this ready by the end of this month.

-- Melvin

Hi,

We also want the new scripts to evaluate the newly added task in XTREME-R, especially mewsli-X dataset. Is it ready now?

Thanks in advance.

Answer 3 · 2022-01-28T12:05:03.000Z

Hi @melvinjosej,

Is there an update on the training and eval scripts for Mewsli-X?

Thanks,

Answer 4 · 2022-04-08T06:12:22.000Z

Hi @melvinjosej,

Is there an update on the training and eval scripts for Mewsli-X?

Thanks,

Answer 5 · 2022-04-08T15:00:01.000Z

Hi @sumanthd17, as mentioned in #83, we spotted some quality issues in the Mewsli-X data. We are just finalizing a fix and doing a more thorough review of the data, which has been taking longer than expected. We expect to be able to release the data soon, in about two weeks.

Answer 6 · 2022-04-30T03:31:42.000Z

Hi @sebastianruder, sorry for the repeated questions. Just wanted to have a quick check if there's any update on this.

Thanks

Answer 7 · 2022-05-02T12:07:07.000Z

Hi @sumanthd17, we are just finalizing the last pieces of the data creation pipeline. We'll be able to share the final data soon. We'll share training and evaluation scripts in a separate update.