/Optimization-for-ML

This Repository provides an Implementation from scratch for Machine Learning Optimizers.

Primary LanguageJupyter NotebookMIT LicenseMIT

Optimization-for-ML

These NoteBooks are for ML Optimization using many techniques such as:

1- Gradient Descent
2- Mini Batch Gradient Descent
3- Stochastic Gradient Descent
4- Momentum Based GD
5- NAG
6- Adagrad
7- RMSProp
8- Adam