/knowledge_distillation

An implementation of knowledge distillation technique in the paper Distilling the Knowledge in a Neural Network with pytorch_lightning, wandb and hydra.

Primary LanguagePythonMIT LicenseMIT

Stargazers