/gradient-descent-from-scratch

Implementing Gradient Descent (Batch and Stochastic) from scratch in a Linear Regression Model

Primary LanguageJupyter NotebookMIT LicenseMIT

Gradient Descent from Scratch

Implementing Gradient Descent (Batch and Stochastic) from scratch in a Linear Regression Model

Notebook

Description

This notebook explores manually applying gradient descent in a Batch and Stochastic way on a Linear Rgression Model.

Goals

  • Get in-depth knowledge of the underlying algorithm of gradient descent
  • Get hands-on experience applying a Regression classifier
    • Made from scratch
    • From Sklearn

Results

We correctly apply gradient descent and our cost function for our regression model gets optimized.

results.png