Implements several representative knowledge distillation methods on transformers
baidu-research/transformer-distiller
Implements several representative knowledge distillation methods on transformers
Python
Implements several representative knowledge distillation methods on transformers
Python