MILVLG/mcan-vqa

Why our reproduced accuracy is so much higher than in the paper.

805934132 opened this issue · 1 comments

805934132 commented

Why our reproduced accuracy is so much higher than in the paper.

Overall Accuracy is: 81.02

Per Answer Type Accuracy is the following:
other : 73.65
yes/no : 95.62
number : 66.90

MIL-VLG commented

Maybe you include the test(val) set into the training set?