This repository contains resources developed within the following paper:
S. Zhang*, Z. Dai*, K. Balog and J. Callan. Summarizing and Exploring Tabular Data in Conversational Search. In: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval, Jul 2020. (* Equal contribution)
data/01-query_tables.csv: 200 query-table pairs.data/02-raw_tables.json: 200 raw tables parsed from Wikipedia. For each table, pageTitle, caption, headings, and rows are provided.data/03-table_type.csv: manually identified table type. There are 64 Sport, 33 Place, 27 Music, 16 Film, 12 Culture, 11 Traffic, 8 Product, and 30Other tables (including Politics, TV series, Award, and Company).data/04-candidate_summaries.csv: candidate summaries collected by a crowdsourcing task on Amazon Mechanical Turk.data/05-sentence_annotations.csv: sentence-level relevance assessments by employing three judges. Each summary was split into sentences.data/06-summary_annotation_votes.csv: summary-level relevance assessments by employing seven judges. Aggregated the votings for the 7 judges, to asign each summary a score.data/06-summary_annotation_raw.csv: summary-level relevance assessments by employing seven judges. Raw annotations.data/07-summary_nlg_cross_validation.zip: train and test files for summary NLG.
@inproceedings{Zhang:2020:SET,
author = {Zhang, Shuo and Dai, Zhuyun and Balog, Krisztian and Callan, Jamie},
title = {Summarizing and Exploring Tabular Data in Conversational Search},
booktitle = {Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval},
year = {2020},
pages = {},
}
If you have any questions, please contact Shuo Zhang at imsure318@gmail.com or Zhuyun Dai at zhuyund@cs.cmu.edu.