SanityLacking/Self-Distillation
Improve a Model's accuracy by distilling knowledge to the earlier layers of the model. Improves accuracy and performance of lightweight DNN models
Jupyter NotebookMIT
Improve a Model's accuracy by distilling knowledge to the earlier layers of the model. Improves accuracy and performance of lightweight DNN models
Jupyter NotebookMIT