keras-team/autokeras

problem: Higher number of epochs lead to worse results?

jbrepogmailcom opened this issue · 1 comments

When I fit model with 200 epochs, results are pretty good, 54% instead 50% for random selection. But when I raise epochs to 500, I get much worse success ratio, under 50%. Why is that and what is optimal number of epochs?

saisua commented

I am not from the Autokeras team, but when training ML models, the optimal number of epochs is a difficult problem and there is no final answer. Usually models improve until a local minima and then they can't go further.
I would suggest you to check Tensorflow's callbacks as I believe they work with Autokeras, so you can control the learning rate to optimize said local minima, or stop at the best epoch.
As for trying to get global minima, there is no way to ensure a model will reach global minima, so instead raise the number of trials.