QuoteSum is a textual QA dataset containing Semi-Extractive Multi-source Question Answering (SEMQA) examples written by humans, based on Wikipedia passages.
The dataset is described in detail in the paper: SEMQA: Semi-Extractive Multi-Source Question Answering (NAACL 2024).
The Quotesum dataset is provided in jsonl format in v1 dir.
The string-based metrics for comparing generated outputs with human-writtern references are provided in the evals dir with an example notebook.
In SEMQA, the answer combines information from multiple sources while explicitly extracting factual spans, and connecting them into a coherent well-grounded passage. See the paper for more details.
