JRC1995/DemonRangerOptimizer
Quasi Hyperbolic Rectified DEMON Adam/Amsgrad with AdaMod, Gradient Centralization, Lookahead, iterative averaging and decorrelated Weight Decay
Python
Issues
- 1
- 2
- 0
Recent pytorch's adam changes
#8 opened by hadaev8 - 39
Instability with HyperProp
#2 opened by hadaev8 - 3
What do you think about diffgrad?
#1 opened by hadaev8 - 3
HyperRangerMod do not work
#4 opened by hadaev8