OSU-NLP-Group/TravelPlanner

Bug: DistanceMatrix tool in prompt didn't match the actual tool name which is GoogleDistanceMatrix

JasonZhu1313 opened this issue · 2 comments

In tool calling prompt, the model is instructed to use the DistanceMatrix tool. However, the actual tool name that is callable is GoogleDistanceMatrix. This mistake will cause the model to initially call DistanceMatrix and then fail with an observation stating that it needs to call the correct tool from the set {... GoogleDistanceMatrix ...} before making the right call. This is likely unintentional, and the model is not supposed to be aware of such a discrepancy.

Bug fix: #4

Hi Jason,

Thank you for your suggestion. I have merged your PR.

In the initial version code, we actually adopted the name "GoogleDistanceMatrix" in the prompt. We changed this in the released code, considering the consistency of the paper and code. Please be assured that this will not influence the experiment results shown in the paper.

Sorry for the confusion. Now, we consistently use "GoogleDistanceMatrix" in the code. Thank you for your insightful reminder.

If you have any further questions, please get in touch with me.

Best,
Jian

Thanks for the detailed explanation, sounds good, great work again on releasing the benchmark