Image and JSON dataset.

Question

Image and JSON dataset.

sxj1215 opened this issue a year ago · 6 comments

Thanks for your great work! I want to use your data to train a model and I wonder how to transform the parquet dataset format into images and JSON file. Thanks in advance!

sxj1215 commented a year ago

Thanks!

Answer 1 · 2024-01-04T09:06:07.000Z

Hi,

Thanks for your interest! Our dataset was not intended for training purposes. All the data samples are for evaluation purposes only. For the dataset format conversion, you might load using hf datasets and then export it into json format.

Thanks,
Xiang

Answer 2 · 2024-01-04T09:24:26.000Z

Many thanks for you detailed reply！I am still wonder how to get all the image file for evaluation. Thanks again！

Answer 3 · 2024-01-04T09:25:35.000Z

You can just load it from HF datasets. From: make fun ***@***.***> Date: Thursday, January 4, 2024 at 5:24 PM To: MMMU-Benchmark/MMMU ***@***.***> Cc: Xiang Yue ***@***.***>, Comment ***@***.***> Subject: Re: [MMMU-Benchmark/MMMU] Image and JSON dataset. (Issue #13) Many thanks for you detailed reply！I am still wonder how to get all the image file for evaluation. Thanks again！ — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented. Message ID: Many thanks for you detailed reply！I am still wonder how to get all the image file for evaluation. Thanks again！ — Reply to this email directly, view it on GitHub<https://urldefense.com/v3/__https:/github.com/MMMU-Benchmark/MMMU/issues/13*issuecomment-1876767487__;Iw!!KGKeukY!znfHeaJ3_HSi60x7FJHPnlJ7PNdHGjaEiKsTwDPF8iN-98PrtwY94nmGtVTKO6r_a9Gn8HbKOw6_Tsn5HZImYv_vNQ$>, or unsubscribe<https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/ADRC4H3N2J66DNYED5RWZ7TYMZYNJAVCNFSM6AAAAABBMTFTJ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZWG43DONBYG4__;!!KGKeukY!znfHeaJ3_HSi60x7FJHPnlJ7PNdHGjaEiKsTwDPF8iN-98PrtwY94nmGtVTKO6r_a9Gn8HbKOw6_Tsn5HZJMWHRRcw$>. You are receiving this because you commented.Message ID: ***@***.***>

Answer 4 · 2024-01-04T15:13:44.000Z

Thank you very much！ How can I get the answer to the test files?

Answer 5 · 2024-01-04T15:29:34.000Z

We did not release the test labels. You can submit your eval results in eval.ai: https://eval.ai/web/challenges/challenge-page/2179/overview From: make fun ***@***.***> Date: Thursday, January 4, 2024 at 11:14 PM To: MMMU-Benchmark/MMMU ***@***.***> Cc: Xiang Yue ***@***.***>, Comment ***@***.***> Subject: Re: [MMMU-Benchmark/MMMU] Image and JSON dataset. (Issue #13) Thank you very much！ How can I get the answer to the test files? — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented. Message ID: <MMMU-Benchmark/MMMU/issues/13/1877258771@ github. com> Thank you very much！ How can I get the answer to the test files? — Reply to this email directly, view it on GitHub<https://urldefense.com/v3/__https:/github.com/MMMU-Benchmark/MMMU/issues/13*issuecomment-1877258771__;Iw!!KGKeukY!3He7iJKV7Ii25CrWlpeynFzSHF2YZcq7MltEtAwfCEMU-d1RYOk_V1xr5KYEFwHi3KU5mW0-x8iJ75IwVCPd8DDDNQ$>, or unsubscribe<https://urldefense.com/v3/__https:/github.com/notifications/unsubscribe-auth/ADRC4HYXFXRPX57GCXACYL3YM3BLFAVCNFSM6AAAAABBMTFTJ2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNZXGI2TQNZXGE__;!!KGKeukY!3He7iJKV7Ii25CrWlpeynFzSHF2YZcq7MltEtAwfCEMU-d1RYOk_V1xr5KYEFwHi3KU5mW0-x8iJ75IwVCPR_BMNSQ$>. You are receiving this because you commented.Message ID: ***@***.***>