MMMU-Benchmark/MMMU

gpt4v refuse to answer/ insist on "I'm sorry, but I'm unable to view images" these kind of things

SweetGUOguo opened this issue · 2 comments

Thanks a lot for your effort!!!
Can I ask if you are experiencing gpt4v refusing to answer/insisting that there is no image provided when you validate gpt4v with mmmu?
I came across the issue above when I tried to send gpt4v the mmmu dataset...

Thanks a lot again!!!!!!!!!!

gpt4v is well aligned.
So better insist them to provide answers even gpt4v claims it cannot view images.

Thank you!!!