sramshetty/mixture-of-depths
An unofficial implementation of "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
PythonNOASSERTION
Stargazers
- alxndrTLMontpellier & Lille, France
- BOOLXXY
- ccssyy
- clabrugere
- deng451e
- geronimi73
- gm8xx8
- lajosdemeMercury Protocol
- leliyliu
- lucasliunju
- MarkYangjiayiTikTok
- Minami-su
- orange-cai
- ostix360France
- peterjc123Shanghai, China
- PhoebusSiUCAS
- putizi-super
- q121q
- RFKxavieryang华中科技大学
- rzr002
- SAMUSENPS
- shyamsn97
- StevenYuan666McGill University
- trifltNUST MISIS
- ultranity
- winglianAnnapolis, MD
- yutianchen666
- zhenyuhe00Peking University
- ZJUcxk2020Zhejiang University
- Zkli-hubShanghai Jiao Tong University
- zolda93