vectorch-ai/ScaleLLM
A high-performance inference system for large language models, designed for production environments.
C++Apache-2.0
Stargazers
- alexchenyu
- annalucia1Stanford University
- arcosx@baidu
- azgo14
- bukit-kronikKRONIK
- chenleiwhuBellevue, WA, US
- dla-010609whu
- fblissjrAptitive
- fluckydog232facebook
- Fred62879the University of British Columbia
- GitMiaoronghua
- gqkPeking University
- hyaihjq
- jadedgnome
- JamieLee0510
- jianghoy
- Kavan72DeftBOX Solutions
- LanLM
- linjiah
- MariasStory
- milkowskiPoland
- nullpointer0xffff
- R3b3lAllianc3
- rossjaRochester, NY
- shijy07Amazon
- stevenchendy深圳
- surmountian
- TenderResilientHeart
- toonnyy8Taiwan,Tainan
- WarrenWen666Glory Ventures
- weianshengAirbnb
- wrchen-voxel
- xain
- Yadan-Wei
- yhyu13Shanghai, China
- YuxiaoHuSeattle