Mrpatekful/swats

Unofficial implementation of Switching from Adam to SGD optimization in PyTorch.

PythonMIT

Issues

How to adjust lr when optimizer changed from Adam to SGD? Thank you !
#19 opened 2 years ago by ilplmm123
0
How to adjust the lr with step?
#13 opened 3 years ago by Geek-lixiang
0
Training After Switch to SGD is Flat
#2 opened 5 years ago by noiran78
4