/RepDistiller-nas-master

Primary LanguagePython

RepDistiller-NAS

Installation

This repo was tested with Ubuntu 16.04.5 LTS, Python 3.5, PyTorch 0.4.0, and CUDA 9.0. But it should be runnable with recent PyTorch versions >=0.4.0

code base on :

https://github.com/HobbitLong/RepDistiller

https://github.com/lukemelas/EfficientNet-PyTorch

https://github.com/MIT-HAN-LAB/ProxylessNAS

Running

  1. 蒸馏第一个student代码如下:

    PYTHONPATH=./ python train_student_imagenet.py --path_t ./save/models/resnet32x4_vanilla/ckpt_epoch_240.pth --distill kd --model_s MobileNetV2 -r 0.1 -a 0.9 -b 0 --trial 1 --path_config ./proxyless_nas/config/net0.config

    第二个student需要修改

    --path_config ./proxyless_nas/config/net0.config

    为

    --path_config ./proxyless_nas/config/net1.config

    后续同理