GiacomoLeoneMaria/Mixture-of-depths
Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
Python
Stargazers
No one’s star this repository yet.
Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
Python
No one’s star this repository yet.