This repository is based on the following two papers and code.
https://openreview.net/forum?id=u_bGm5lrm72
https://github.com/xuguodong03/SSKD
To run it, follow the steps below.
Download the weights from the following URL
https://drive.google.com/drive/folders/15EJoPnnOirsI2R5uRzL6xK7fJQSnApV5?usp=sharing
Next, run the experiment with run.sh retrain_distillation.
Finally, visualize the calculation with run.sh float_calculation.