MNIST MLP
Quick Start
To setup with conda/pip (assuming they already installed):
source setup.sh
To train the model and generate .h5
and .json
files:
make train
To test the model:
make prediction
To prune the model to 90% sparsity:
make prune
To check the model compression:
python check_compression.py
To run a hyperparameter scan with guild.ai:
guild run train epochs=100 optimizer=[adam,nadam,rmsprop,sgd] dropout_rate=[0,0.1,0.2] l1_reg=[0,1e-5,1e-4]
To run different pruning hyperparameters:
guild run prune epochs=100 optimizer=[adam,nadam,rmsprop,sgd] final_sparsity=[0.3,0.5,0.7,0.9,0.95,0.97,0.99]