/GradientDescent_Implementation

Implement different variants of gradient descent in python using numpy

Primary LanguageJupyter NotebookMIT LicenseMIT

Gradient Descent Implementation

This repository contains the code to implement gradient descent in python using Numpy

Repository Structure

  • GDAlgorithms: Contains code to implementing various gradient descent algorithum in sigmoid neuron.
  • VectorisedGDAlgorithms: Contains code to implementing different gradient descent algorithums in feed forward neural network

Jump into code

  • Different Types of Gradient Descent Optimizers in Sigmoid Neuron

    Click here to open in Colab

  • Different Types of Gradient Descent Optimizers in Feedforward Neural network
    Open In Colab

Visualization

  • Visualizing the Gradient Descent learning algorithum Gradient Plots

  • Animation of Gradient Descent Gradient Plots