- Run NAS.ipynb to study the benchmark and NAS algorithms.
- mobilenetv2.py, ShuffleNetv2.py define search spaces.
- Training with various KD methods were done via https://github.com/HobbitLong/RepDistiller.
IlyaTrofimov/MF_NAS_KD
Multi-fidelity Neural Architecture Search with Knowledge Distillation
Jupyter Notebook