MiuLab/FlowDelta

Is it allowed that to use previous real answer in the prediction process ?

pengshuang opened this issue · 2 comments

Hi,

I have one question about the prediction process.

Here your code uses the previous real question and original answer as the context information in the evaluation process.

question_text = '{}<q>{}<a>{}'.format(paragraph['qas'][qa_idx - 1]['question'],

Is it allowed ?

Yes, it is allowed in both QuAC and CoQA datasets.
When you predict the question in turn t, you can use ground truth answer from trun 1 to trun (t-1).

thanks