The second edition of the MEDIQA challenge will be organized at NAACL-BioNLP 2021 and will focus on summarization in the medical domain with three tasks: Consumer health question summarization, Multi-answer summarization, and Radiology report summarization.
-
Post-challenge Round: https://www.aicrowd.com/challenges/mediqa-2021
-
Mailing list: https://groups.google.com/forum/#!forum/bionlp-mediqa
-
Previous edition: https://sites.google.com/view/mediqa2019 & https://github.com/abachaa/MEDIQA2019
Task 1 (question summarization): https://github.com/abachaa/MEDIQA2021/tree/main/Task1
Task 2 (multi-answer summarization): https://github.com/abachaa/MEDIQA2021/tree/main/Task2
Task 3 (radiology report summarization): https://github.com/abachaa/MEDIQA2021/tree/main/Task3
-
The AIcrowd platform will be used for releasing the test sets and submitting runs.
-
ROUGE will be used as the main metric to rank the participating teams, but we will also use several evaluation metrics more adapted to each task such as HOLMS and CheXbert.
The registration & data usage agreement form is available under the Resources section of the AIcrowd projects.
The form covers the three tasks. You can download it from any of the three MEDIQA projects: QS@AIcrowd, MAS@AIcrowd & RRS@AIcrowd.
To register, you need to complete, sign, and upload the form. When approved, you will be able to download the official test sets and to submit your runs on the AIcrowd submission systems.
- Asma Ben Abacha, NLM/NIH
- Chaitanya Shivade, Amazon
- Yassine Mrabet, NLM/NIH
- Yuhao Zhang, Stanford University
- Curtis Langlotz, Stanford University
- Dina Demner-Fushman, NLM/NIH