google-research/xtreme
XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.
PythonApache-2.0
Issues
- 0
Regarding NER finetuning
#103 opened by malduwais - 2
WikiExtractor git cloning error
#102 opened by SatanuG - 0
There is no AmazonPhotos.zip in the link to download the dataset. How to download the dataset?
#101 opened by zeda-li - 0
explainaboard doesn't work
#100 opened by vmkhlv - 3
Evaluation results of PANX task
#93 opened by sakuraimai - 1
[bugs] All results 0 in test with the NER(PANX) task
#99 opened by A11en0 - 1
Missing de translation data in MLQA
#98 opened by NicholasCao - 0
Tatoeba baseline from XTREME-R
#97 opened by pefimov - 0
Adding a new language
#96 opened by peregilk - 5
- 3
How is the test data for TyDiQA generated?
#95 opened by namiyousef - 0
Training data for XCOPA
#92 opened by namiyousef - 0
Old Russian in Russian UDpos dataset
#91 opened by moshemm - 1
- 0
TypeError: compute_predictions_logits() takes 12 positional arguments but 13 were given
#88 opened by HK-Zhong - 0
XCopa scripts?
#89 opened by Fengwills - 7
Mewsli-X scripts
#78 opened by sumanthd17 - 0
Cannot achieve the XNLI performance in the paper
#87 opened by Mingqi7 - 5
New tasks in xtreme-r
#83 opened by shunyuzh - 1
2513 Segmentation fault: 11 when running Tatoeba
#86 opened by vrmer - 6
- 2
XLMR results on POS tagging (ja, zh and yo)
#84 opened by amineabdaoui - 1
out of memory
#82 opened by Fengwills - 0
Missing languages in udpos task
#81 opened by fe1ixxu - 2
- 4
Plans for making codebase compatible with newer versions of Huggingface transformers
#77 opened by KeremZaman - 7
XTREME-R Availability
#67 opened by sumanthd17 - 0
Typo in bucc_extract() causing errors
#75 opened by KeremZaman - 0
- 4
- 2
Bug in PawsxProcessor
#70 opened by amineabdaoui - 7
MLQA results reproducability for XLM-R
#38 opened by hit-computer - 2
- 5
LaReQA (XQUAD-R) results reproducability for mBERT
#64 opened by Doragd - 1
mistake in evaluate_retrieval.py line 517
#69 opened by ffaisal93 - 1
run_retrieval.py file not found
#68 opened by ffaisal93 - 2
Bug in tydiqa training/evaluation file?
#66 opened by ffaisal93 - 0
Error while using xlm-mlm-100-1280 in udpos
#62 opened by Dereck0602 - 1
Tatoeba Labels
#61 opened by samsontmr - 0
Evaluation of bucc2018
#60 opened by chenQ1114 - 1
Adding languages
#55 opened by peregilk - 1
Bug in conll.py
#59 opened by amralaa-MSFT - 0
line 65: 25580 Segmentation fault
#54 opened by chenQ1114 - 2
Possible error in structure prediction tasks
#56 opened by tonytan48 - 2
XNLI Processor alignment issue
#57 opened by tonytan48 - 1
How to use the tydiqa dataset
#53 opened by marc-tanti - 1
Tatoeba code is broken
#49 opened by ritterng - 4
Translation data
#37 opened by panl2015 - 1
- 5