Implementation of YOGI optimizer as mentioned in the paper https://papers.nips.cc/paper/8186-adaptive-methods-for-nonconvex-optimization.
Yogi is an optimizer proposed to overcome the disadvantages of Adam Optimizer.
This is the first implementaion of Yogi Optimizer in PyTorch.
Refer to PyTorch folder README for running the code.
-
Implement Yogi in
a) MxNet
b) Tensorflow
-
Add more experiments such as:
a) Auto Encoders
b) Machine Translation