/numerical-optimization-python

Implementation of famous numerical optimization algorithms from scratch using python

Primary LanguageJupyter Notebook

🚀 Numerical Optimization using Python

Numerical Optimization is one of the central techniques in Machine Learning

This repo is my implementation to various numerical optimization algorithms from scratch in python

⚙️ Getting Started

Just clone or download the repo and make that you have python installed (Recommend in a virtual env) then install :

  • numpy
  • pandas
  • matplotlib
  • sklearn

Make sure that datasets are in the same directory:

  • MultipleLR.csv
  • RegData.csv

💁 What You're Getting

├── src
├────── 1. GD Implementation for LR
├────── 2. GD Variants Batch - Mini-Batch - Stochastic
├────── 3. Momentum - NAG
├────── 4. Adagrad - RMSProp - Adam
├────── 5. Adam (Batch - Mini-Batch) Algorithm Multivariable
├────── MultipleLR.csv
├────── RegData.csv