google-research/xtreme

New tasks in xtreme-r

shunyuzh opened this issue · 5 comments

shunyuzh commented

Hi folks,

Could we get training and evaluation scripts for new added tasks in xtreme-r, such as mewsli-X dataset? Or would you have a plan to share these scripts and data?

Thanks.

sebastianruder commented

Hi,
I'm really sorry about the delay on this. The data release for Mewsli-X in particular has been taking longer than expected. We're working on releasing the scripts and data as soon as possible.

LeonardoEmili commented

Hey @sebastianruder, any updates on releasing the data and the evaluation scripts for mewsli-x?

sumanthd17 commented

Hi @sebastianruder @melvinjosej any updates in the mewls-x? Sorry for the repeated questions, but we could really use the scripts and data for evaluation. Since it's almost been a year since the release of the original paper, Can you give us a timeline on when we could get it? It would really help us to get this available ASAP.

sebastianruder commented

Hi all, I'm really, really sorry about the delay on this. We had noticed some quality issues in the extracted web data used for training the Mewsli-X models that we are just trying to fix in order to be able to release a high-quality dataset. @bothameister is currently working on this, so this should be ready very soon.

Rispo997 commented

Hi all, I'm really, really sorry about the delay on this. We had noticed some quality issues in the extracted web data used for training the Mewsli-X models that we are just trying to fix in order to be able to release a high-quality dataset. @bothameister is currently working on this, so this should be ready very soon.

Hi sebastian, do you know when the new tasks will be available?