astramind-ai/Mixture-of-depths
Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
Python
Stargazers
- alexandonianMIT CSAIL
- AlexFierro9
- andreajparkerCalifornia
- Art9681
- balsulami
- bnorick
- Curiosity007
- dbuades@clinia
- dobribanThe Wharton School, University of Pennsylvania
- GiacomoLeoneMariaMilano, Italy
- hiyougaMillennium Science School
- Iron-Bound127.0.0.1
- itechbear
- jpabbuehlSwitzerland
- jsvan
- KpKqwq
- M-SaltiDubai, UAE
- MikeLPair-lab
- mlinmg
- nanoflooder
- NikolayDPaev
- rkunnamp
- rohan-paulhttps://www.linkedin.com/in/rohan-paul-ai
- samuelfogarty
- SAMUSENPS
- SandalotsVolcanak
- sasikiranValueLabs, LLP
- seanxuuCentre for Artificial Intelligence and Robotics, Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences
- severian42
- sherycUniversité de Montréal / Mila
- stephenleoSingapore
- Stonedge
- thekitchenscientist
- trestadSomewhere
- winglianAnnapolis, MD
- Zkli-hubShanghai Jiao Tong University