double-descent-pytorch
Implementation / replication of double descent curve with PyTorch on MNIST in this paper and specifically its ArXiv version.
To reproduce figure.9 (a) and (c), run the following command. Control whether to use weight reuse with flag --reuse. It took around 15 hours to create a single figure on one 1080ti gpu.
python mnist_double_descent.py --reuse --verbose 1
| With weight reuse | Without weight reuse |
|---|---|
 |
 |
 |
 |