How many questions do you have on that mathematical reasoning data?

Question

How many questions do you have on that mathematical reasoning data?

zwq2018 opened this issue a year ago · 3 comments

zwq2018 commented a year ago

How many questions do you have on that mathematical reasoning data? The paper claims there are only 50 questions? Only 10 questions in the code file?

Answer 1 · 2023-11-09T13:11:40.000Z

We release Counter-Intuitive AR dataset here, which contains 50 questions.

Answer 2 · 2023-11-09T13:15:02.000Z

50 questions are not enough for a comprehensive evalution

Answer 3 · 2023-11-09T14:30:00.000Z

We acknowledge this issue, and we will consider expanding the dataset as much as possible, at least to 100 questions. Thank you for your feedback and suggestions.