An interesting phenomenon when testing on RegDB

[Zoky-2020]

When testing on RegDB, Rank-1, mAP, mINP seem right in the first round.
But in the next few rounds, the indexes are abnormally high.

So I checked test.py and found that the test_trial is changing in the testing process, which means that the train-test splitting is different from that of training process.
The images in the training process might be divided into test set if the train-test splitting changed, so the indexes are extremly high.
Is that right?

[mangye16]

For RegDB dataset, you need to train 10 different trials, and then evaluate it in ten corresponding trials, i.e., train trial 1 and evaluate test trial 1.

[Zoky-2020]

Thank you very much.