About validation
juanguang opened this issue · 0 comments
juanguang commented
I notice that in both reasoner and inspector module, the dataset for validation is range(8)
for example:
https://github.com/Sleepychord/CogLTX/blob/main/reasoner_module.py#L43
I'm not familiar with pytorch lightning, I wonder does it mean that we dont do validation during training?
if that's the case, so that the latest model is the best model as infered in the code(which means that we dont do early stop)?