/Gradient_Descent_Variations

Implementations of Gradient Descent Variations as a Proof of Concept.

Primary LanguageJupyter Notebook

Gradient_Descent_Variations

Implementations of Gradient Descent Variations as a Proof of Concept.

  • Vanilla GD, Mini-Batch GD, Stochastic GD, Momentum, NAG, AdaGrad, RMSProp and Adam.