ubc-vision/image-matching-benchmark

No such file or directory:"keys-th-{:0.1f}.npy"

Closed this issue · 9 comments

Hi. If I run run.py on a test set, an error occurs when computing matches because there are no "keys-th-{:0.1f}.npy" files. So If I want to test it on my own data, how to generate "keys-th-{:0.1f}.npy" file? thanks.

You cannot run experiments on the test set because you don't have the ground truth. That will be only the first of many errors. We will not share the ground truth for the test data, because it's part of a public challenge. If you want to compute results on the test set, please send a challenge submission (check the website for instructions).

Thanks. If I just want to visualize the matching results after feature extraction, what should I do.

They will be automatically uploaded to the website (a subset of it). Please check any entry on the leaderboards for examples.

Sorry. I mean that I just want to visualize the matching results of the validation dataset,after training the model. I don't need to compare it with ground truth.

Those will be dumped automatically into ../benchmark-visualization. If you want more images, you can play with the parameters.

Yeah, I know. But by run.py, it not only visualizes the results but also calculates match, filer, and so on. But I don't have the ground truth. I can't calculate the match. I just want to visualize the results.

You do have ground truth for validation set, download it from all_sequences.
image

https://vision.uvic.ca/imw-challenge/index.md

@ducha-aiki . Do I have to have groundtruth to visualize the match results?

Yes, because our match visualization script colors matches conditionally on them being wrong or correct:
image

Of course, you can hack into the script and remove that dependence, but in those case you need to do it yourself.