Reproduce the evaluation result

Question

Reproduce the evaluation result

qbKhanh opened this issue 4 months ago · 6 comments

Thanks for your very good open-source!
I want to reproduce the evaluation result on VQA-RAD dataset but some info that do not have in original dataset like "conversations" or "answer_type". How can I get that annotation like yours!
Thank you!

Answer 1 · 2024-09-11T10:15:21.000Z

Dear qbKhanh,

Thank you for your interest in our work on the VQA-RAD dataset.

We've made VQA-RAD with the additional annotations ("conversations", "answer_type", etc.) available here:

https://drive.google.com/drive/folders/1QPSFZpWZBqy49t7rNjef9TNpEj79JSpw?usp=sharing

This should help you reproduce our evaluation results. If you need any further assistance, please let us know.

Answer 2 · 2024-09-11T10:19:26.000Z

Dear @yunfeixie233,

I am so surprised by your fast reply. Thanks for your help!

Answer 3 · 2024-09-11T10:27:45.000Z

Apologies for the oversight. I also intend to reproduce results on the PathVQA and SLAKE datasets. Could you please provide access to them? Thank you for your assistance.

Answer 4 · 2024-09-12T08:32:47.000Z

Dear @qbKhanh ,

Path-VQA: Google Drive Link
SLAKE: Google Drive Link

These links are provided for non-commercial research purposes. I am redistributing these datasets under the permissions granted by their respective licenses. Please ensure compliance with the original license terms for each dataset. For specific license details, refer to Dataset Availability and Licensing and Understanding Dataset Licenses for Public Sharing.

If you need any further assistance, please let us know.

Answer 5 · 2024-09-12T08:52:38.000Z

Dear @yunfeixie233 ,

Thank you very much for providing the links to the PathVQA and SLAKE datasets. I appreciate your support and will ensure full compliance with the respective licenses while utilizing these resources for my research.

If I encounter any further questions or need clarification, I will reach out.

Best regards,
@qbKhanh