/implicit-reg-sharpness

Primary LanguagePythonMIT LicenseMIT

Deep linear networks for regression are implicitly regularized towards flat minima

Environment

With conda

conda env create -f environment.yml

With pip

Install Python 3.9.19 and pip 24.0, then

pip3 install -r requirements.txt

Reproducing the experiments of the paper

To reproduce all the plots in the paper, run

python run_experiment.py linear

and

python run_experiment.py nonlinear

The code takes around 3 hours to run on a laptop CPU.