clementw168/Implicit-acceleration-by-overparametrization

This repo aims to reproduce the results of Arora, S., Cohen, N., & Hazan, E. (2018, July). On the optimization of deep networks: Implicit acceleration by overparameterization. In International Conference on Machine Learning (pp. 244-253). PMLR.

Jupyter NotebookMIT