Picking the best checkpoint in the pre-exploration setting.
zwx8981 opened this issue · 2 comments
zwx8981 commented
Hi, how did you select the checkpoint for test in the pre-explpration setting ? Did you still pick the checkpoint according to the performances on the validation-unseen set?
airsplay commented
Yea, according to the single-run validation-unseen result only.
But I think that it is allowed to use the validation-unseen to pick the best checkpoint as long as the results on test environments are shown.