night-chen/ToolQA

the question and answer are mismatch

Closed this issue · 1 comments

Ericmututu commented

Hi,

Thank you for sharing this wonderful dataset. I note a mismatch issue between question and answer in Line 21-40. It seems to be caused by dataset_generation/hard_questions/hard_agenda.ipynb of In [10]:.

BTW, I am very curious about the detailed process of calling APIs during inference. Looking forward to Benchmark Code being released soon (:

night-chen commented

Thank you for pointing this out. This typo is made during our code cleaning, all the "Who is unavailable..." questions you have pointed out are all "How many people are unavailable...?". We have made changes accordingly.

The benchmark code will be released before July 15th (the latest date). That commitment will include the tools implementations. Thank you for your interest in our work and your valuable suggestions!