Can I just evaluate the results on the test set but not submit them to the leaderboard?

[Jizma]

Hi, it is a good benchmark for image matching community, but some times, I would like to just use it to improve our method rather than participate in the challenge directly.

[kmyi]

In that case you can use the validation sets, or whatever split you desire. It should be an easy fix. We won’t be able to release the test sets, since we intend to keep the challenge going for at lease a few years. Thanks Message written with iPhone. Please excuse any brievity and typos. — Kwang Moo YI Assistant Professor Dept. of Computer Science University of Victoria +1 (250) 475 5837

…

On Jun 9, 2020, at 20:52, Jizhou Ma ***@***.***> wrote:  Hi, it is a good benchmark for image matching community, but some times, I would like to just use it to improve our method rather than participate in the challenge directly. — You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub, or unsubscribe.

[Jizma]

Thank you for your answer