/over9000_lamb

Primary LanguageJupyter Notebook

The repository is based on https://github.com/mgrankin/over9000

We study the performance of LAMB optimizer for Imagenette and Imagewoof (size 128, 5 epoch).

How to reproduce? Just hit ./run_imagenette.sh or ./run_imagewoof.sh

We are not sure the LAMB implementation is correct.

Accuracy for Imagenette over 20 runs: 0.861

Accuracy for Imagewoof over 20 runs: 0.605