Implement Adam as a LearningRule

Question

Opened this issue 10 years ago · 3 comments

Citation: Adam: A Method for Stochastic Optimization. Diederik Kingma, Jimmy Ba. http://arxiv.org/abs/1412.6980
Implementation in Theano by Alec Radford (@Newmu): https://gist.github.com/Newmu/acb738767acb4788bac3

Answer 1 · 2015-02-21T00:46:59.000Z

Is someone already working on this? If not, I might try it out next week.

Answer 2 · 2015-02-27T22:36:08.000Z

I'd like to request this please 👍

Answer 3 · 2015-03-04T17:36:21.000Z

Starting working on this in #1425.