Rygbee/qa-datasets

Collection of Question Answering (QA) datasets from various source. The goal of this project is to provide a comprehensive collection of questions and answers to accelerate the development of future QA systems.

#Question answering datasets

This collection includes the following datasets or respectivly looks at the following datasets to be included:

• added: http://www.okbqa.org/nlq
• added: http://greententacle.techfak.uni-bielefeld.de/~cunger/qald/
• added: http://linkedspending.org

in production (adding answers):

• https://www.stonetemple.com/great-knowledge-box-showdown/

to analyze:

• https://github.com/brmson/yodaqa/wiki/Benchmarks
• http://www-nlp.stanford.edu/software/sempre/
• https://sites.google.com/site/trecliveqa2015/
• http://trec.nist.gov/data/qa.html
• http://trec.nist.gov/data/qamain.html
• http://trec.nist.gov/data/qa/add_qaresources.html
• http://www.slideshare.net/andrenfreitas/schema-agnostic
• http://research.microsoft.com/en-us/downloads/88c0021c-328a-4148-a158-a42d7331c6cf/
• http://projects.semwebcentral.org/ (?)
• http://research.signalmedia.co/newsir16/signal-dataset.html
• needs computation: https://github.com/deepmind/rc-data/

out of scope (?) :

• http://alt.qcri.org/semeval2015/task3/ SemEval-2015 Task 3: Answer Selection in Community Question Answering
• http://alt.qcri.org/semeval2016/task3/ Semeval-2016 Task 3: Community Question Answering

Focus

This collection aims at becoming a central focus point of question answering research. Using deeper analysis (sentiment, clustering, topic) of a questions will help to understand arising difficulties within QA systems. Moreover, this collection will help also semantic search, e.g. keyword search, phrase search, in later stages.

Maven Dependency

This library is available as snapshot here: http://maven.aksw.org/archiva/#artifact~snapshots/org.aksw.qa/datasets

<dependency>
  <groupId>org.aksw.qa</groupId>
  <artifactId>datasets</artifactId>
  <version>0.0.1-SNAPSHOT</version>
</dependency>

Add the following repository:

<repository>
			<id>maven.aksw.internal</id>
			<name>University Leipzig, AKSW Maven2 Repository</name>
			<url>http://maven.aksw.org/archiva/repository/internal</url>
		</repository>
		<repository>
			<id>maven.aksw.snapshots</id>
			<name>University Leipzig, AKSW Maven2 Repository</name>
			<url>http://maven.aksw.org/archiva/repository/snapshots</url>
</repository>

Look for more interesting libraries here: http://maven.aksw.org/archiva/#browse/org.aksw.qa