Model not learning

Question

Model not learning

tumis1946 opened this issue 3 years ago · 7 comments

tumis1946 commented 3 years ago

Thanks very much for sharing your work with us.

I wish to ask for your help. I have trained the model from scratch for more than 4000 epochs, but, it is not learning. I did not change anything in your code except the directory for IAM. The pre-trained model that you shared was trained for 2000 epochs and it is a thousand times better than the model I trained for 4000 epochs.

Please, let me know if I have to make any changes in your code for learning to take place.

Thanks

Answer 1 · 2021-09-02T22:43:04.000Z

tumis1946 commented 3 years ago

Answer 2 · 2021-09-02T22:44:27.000Z

As shown above, it looks like the classifier (l_cla) is suffering from overfitting. That is, comparing EVAL to tr-gen values

Answer 3 · 2022-03-25T10:32:59.000Z

hi ,I got that same problem even I trained for 10000 epochs after 4000 epochs nothing much change . Can i have some tricks
and you say you have pre-trained model that trained for 2000 epochs where will i find it.

Answer 4 · 2022-03-25T10:49:11.000Z

The pretrained model is referenced in this issue: #5
I'm currently not working on this project anymore, so I can't provide you with better pre-trained models.

Answer 5 · 2022-03-28T13:27:21.000Z

hi ,I got that same problem even I trained for 10000 epochs after 4000 epochs nothing much change . Can i have some tricks and you say you have pre-trained model that trained for 2000 epochs where will i find it.

hello Bird9000: Sorry for the late reply. My problem was that I was new to GAN training, and so, I focused on metrics. As training progresses, what you have to do is observe the intermediate results in imgs/ folder. Even though the training and validation metrics may appear poor, the intermediate results in imgs/ folder indicate that the model is learning. If you do not change any parameters in the model, then, between epoch 400 and 1000, you should start to see that the errors in the intermediate images in folder imgs/ are significantly less. You do not need to train for more than 2000 epochs, assuming you do not change parameters in the current model.

Answer 6 · 2022-03-28T13:30:13.000Z

hello Bird9000: Sorry for the late reply. My problem was that I was new to GAN training, and so, I focused on metrics. As training progresses, what you have to do is observe the intermediate results in imgs/ folder. Even though the training and validation metrics may appear poor, the intermediate results in imgs/ folder indicate that the model is learning. If you do not change any parameters in the model, then, between epoch 400 and 1000, you should start to see that the errors in the intermediate images in folder imgs/ are significantly less. You do not need to train for more than 2000 epochs, assuming you do not change parameters in the current model On Friday, March 25, 2022, 05:33:12 AM CDT, Bird9000 ***@***.***> wrote: hi ,I got that same problem even I trained for 10000 epochs after 4000 epochs nothing much change . Can i have some tricks and you say you have pre-trained model that trained for 2000 epochs where will i find it. — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: ***@***.***>

Answer 7 · 2022-03-29T07:47:52.000Z

thank you for the information @tumis1946 @hendraet