/Multi-Level-Logit-Distillation

Code for 'Multi-level Logit Distillation' (CVPR2023)

Primary LanguageJupyter Notebook

Code release for Multi-level Logit Distillation (CVPR2023).

The code is built on mdistiller.

Installation

Environments:

  • Python 3.8
  • PyTorch 1.7.0

Install the package:

sudo pip3 install -r requirements.txt
sudo python3 setup.py develop

CIFAR-100

Training on ImageNet

  • Download the dataset at https://image-net.org/ and put them to ./data/imagenet

    python3 tools/train_ours.py --cfg configs/imagenet/r34_r18/kd_ours.yaml

Acknowledgement

Sincere gratitude to the contributors of mdistiller for your distinguished efforts.

Contact

Ying Jin: sherryying003@gmail.com