Error analysis using question rewrites for conversational question answering. Supplementary materials for "A Wrong Answer or a Wrong Question?.." https://www.aclweb.org/anthology/2020.scai-1.2.pdf
- altair
- rouge_score
query_metrics file is generated from a TREC run file using:
grep '^map\s\|recip_rank\|^P_1\|^P_3\|ndcg_cut_1\|ndcg_cut_3\|ndcg_cut_5' original.run | grep -v "all" > original_query_metrics.txt
Please cite our paper if you found these resources useful.
@inproceedings{vakulenko2020wrong,
title={A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answering},
author={Vakulenko, Svitlana and Longpre, Shayne and Tu, Zhucheng and Anantha, Raviteja},
booktitle={Proceedings of the 5th International Workshop on Search-Oriented Conversational AI (SCAI)},
pages={7--16},
year={2020}
}