/Network-Permutations

Experiments in permutation search and interpolation methods for ResNets on CIFAR-10

Primary LanguageJupyter Notebook

Network-Permutations

Experiments in permutation search and interpolation methods for ResNets on CIFAR-10

LayerNorm vs BatchNorm without reset LayerNorm vs BatchNorm with reset

All experiments use the FFCV dataloader to speed things up. The script write.py should be run first in order to generate .beton files.