Anyone getting good results on the nancy dataset?
Opened this issue · 1 comments
jacksmite commented
It has been training for 120k global steps, but the loss curves seem to be fixed.
Any suggestions?
onyedikilo commented
have you tried decreasing the learning rate gradually ?