loss exploded
YisenWang opened this issue · 3 comments
YisenWang commented
Does anyone run into this issue ? In the training process, "loss exploded" threw out and the training is stopped.
candlewill commented
Yes. I decreased the learning rate, and then restored training.
YisenWang commented
@candlewill how large is your lr?
candlewill commented
0.001, 0.0005, 0.0003, 0.0001, 0.00005, ...