Implement Adam as a LearningRule
Opened this issue · 3 comments
lamblin commented
Citation: Adam: A Method for Stochastic Optimization. Diederik Kingma, Jimmy Ba. http://arxiv.org/abs/1412.6980
Implementation in Theano by Alec Radford (@Newmu): https://gist.github.com/Newmu/acb738767acb4788bac3
JesseLivezey commented
Is someone already working on this? If not, I might try it out next week.
Deleted user commented
I'd like to request this please 👍
JesseLivezey commented
Starting working on this in #1425.