SemEval-2020-Task-5

Data and baseline code for SemEval-2020 Task 5: Modelling Causal Reasoning in Language: Detecting Counterfactuals.

Our task description paper

SemEval-2020 Task 5: Counterfactual Recognition (available on arXiv 2020-08-03)

This repo contains

./Subtask-1: data for subtask-1
./Subtask-2: data for subtask-2
./Baseline-Subtask1-SVM: SVM script for subtask-1
./Baseline-Subtask2-SequenceLabeling: Sequence labeling model for subtask-2

CodaLab

We also set up a competition webpage on CodaLab, where you could find the official leaderboard of SemEval-2020.

https://competitions.codalab.org/competitions/21691

Reference

Please cite our work if you use the dataset in your reasearch.

LaTex

@inproceedings{yang-2020-semeval-task5,
title = "{S}em{E}val-2020 Task 5: Counterfactual Recognition",
author = "Yang, Xiaoyu  and
  Obadinma, Stephen and
  Zhao, Huasha  and
  Zhang, Qiong  and
  Matwin, Stan  and
  Zhu, Xiaodan", 
booktitle = "Proceedings of the 14th International Workshop on Semantic Evaluation (SemEval-2020)",
year = "2020",
address = "Barcelona, Spain",
}

Xiaoyu Yang, Stephen Obadinma, Huasha Zhao, Qiong Zhang, Stan Matwin, and Xiaodan Zhu. 
2020. SemEval-2020 Task 5: Counterfactual Recognition. In Proceedings of the 14th 
International Workshop on Semantic Evaluation (SemEval-2020), Barcelona, Spain.

Resources are also available at

https://zenodo.org/record/3932442

Contact Us

task5.counterfactual at gmail.com