Is cosine annealing with warm restarts lr scheduler implemented in the notebook?
HumbleStranger opened this issue · 2 comments
HumbleStranger commented
If not, is it possible to enable somehow?
Sorry if it's a dumb question, but I'm not code-savvy.
hollowstrawberry commented
Cosine annealing is not in the trainer, I don't think I know how to add it
HumbleStranger commented
That's a shame, but thanks.