cogtoolslab/physics-benchmarking-neurips2021

Error in feedback on familiarization trial for dominoes

judithfan opened this issue · 3 comments

Spotted this error in feedback in second familiarization trial of this dominoes demo (https://cogtoolslab.org:8882/index.html):
Problem: Says that I got it right when I predicted that "red" would not hit "yellow" but then said that "The red object did indeed hit the yellow area."

image

image
Strange, it has the correct ground truth for me. Must be an error in the logic. Do you remember whether you get the first one correct, Judy?

I double checked, it's the logic that generates the prompt. Ground truth and logging are still correct

It was just a typo in the response :/ Thanks to @DylanTao for figuring that out