vince-CV/optimization-in-deep-learning
Optimization algorithms commonly used in deep learning, mini-batch GD, SGD, and momentum methods AdapGrad, Adam... advanced methods Newton, quasi-Newton, L-BFGS...
Python
Optimization algorithms commonly used in deep learning, mini-batch GD, SGD, and momentum methods AdapGrad, Adam... advanced methods Newton, quasi-Newton, L-BFGS...
Python