/mipt_optimizations-theory

Gradient Descent and Heavy-Ball method implementations

Primary LanguageJupyter Notebook

Optimization Theory

  • Heavy-Ball Method for |avg(x_{k}) - avg(x_{k+1})| < Eps
  • Quadratic functions: f(x) = (x^T . A . x) - (B^T . x)