question about evaluation and test?
yasuobinggan opened this issue · 2 comments
yasuobinggan commented
Hi, During the test and train of Helen dataset, I find that the optimal model is chosen from the evaluation results, but I found that the evaluation and test used the same set of data, which made me a little confused. Is this reasonable?
Steve-Tod commented
Hi, it is a little tricky. Since the size of Helen dataset is too small, it's hard to train&eval on this set, so we just evaluate on the train set.
yasuobinggan commented
OK, thank you very much!