automl-edu/AutoMLLecture

Train/Validation/Test Usage of Terms

jakob-r opened this issue · 1 comments

So I guess we stick to the terminology that is also used in Wikipedia which seems to be in line with the AutoML book?

Inner CV: Train / Validation
Outer CV or Holdout: Train / Test

If so we have to scan the slides again. Sometimes it is hard to decide whether we should talk about validation or test.
Here for example
image
i think it is okay for illustrative purposes, although we use the test set multiple times.
But here I would change it to validation in the inner cv:
image
If you agree I can make a PR.

I have no strong opinions on this.