/ML_Optimization_Methods

Implementation of optimization techniques in machine learning

Primary LanguageJupyter NotebookMIT LicenseMIT

Machnie learning Optimization Methods

  • Implementation of optimization techniques in machine learning
  • Nov. 11, 2021 ~ Present

1. Implementing neural networks without using deep learning frameworks | Code

  • Mini-batch gradient descent, Momentum, RMSprop, Adam

2. Implementing custom optimizer in tensorflow.keras | Code

  • Adam

Dataset

[1] http://scikit-learn.org/stable/modules/generated/sklearn.datasets.make_moons.html
[2] https://www.tensorflow.org/api_docs/python/tf/keras/datasets/fashion_mnist/load_data

References

[1] Improving Deep Neural Networks: Hyperparameter Tuning, Regularization and Optimization, deeplearning.ai
[2] Custom Optimizer in TensorFlow, https://towardsdatascience.com/custom-optimizer-in-tensorflow-d5b41f75644a
[3] Adding Custom Loss and Optimizer in Keras, https://soutikc.medium.com/adding-custom-loss-and-optimizer-in-keras-e255764e1b7d
[4] Writing Custom Optimizer in TensorFlow Keras API, https://cloudxlab.com/blog/writing-custom-optimizer-in-tensorflow-and-keras/