pkglimmer/Gradient-descent-R-demo

Implementation of vanilla gradient descent, Newton’s method, damped Newton’s method, conjugate gradient descent method, momentum, Nesterov accelerated gradient, Adagrad, Adadelta/RMSprop, and Adam.

R