/transformer-distiller

Implements several representative knowledge distillation methods on transformers

Primary LanguagePython

Stargazers