jlamprou/Infini-Attention
Efficient Infinite Context Transformers with Infini-attention Pytorch Implementation + QwenMoE Implementation + Training Script + 1M context keypass retrieval
Python
Stargazers
- 18140663659ccnu
- 2793145003
- 4IK1d
- BeomiSeoul, South Korea
- BigRabit12138
- BogyieLG U+
- carry0987@adakrei
- christofilojohn
- ckybit
- dmarxStability.ai, Eleuther.ai
- drwinerWashington DC
- dumpmemory
- GynshuArmenian
- Hasan-Syed25Pakistan
- huanqingxu
- huliangbing
- JeffCarpenterCanada
- jiahe7aySouth China Normal University
- jinxxo-jhttps://cilab.yonsei.ac.kr/
- jlamprouParasecurity Group || Technical University of Crete
- jshuadvd
- khs0415pSeoul
- lopper
- maxupengChina
- MichealleiHefei China
- mifok
- MoFHekaKanzhun.inc
- Mon-iusMonius Tech
- Narottam04Mumbai
- okzhiliBaidu
- ostix360France
- PranayShah@NymCard-Payments
- QLiMBer
- SAMUSENPS
- tmggr
- ZackZikaiXiao