modelscope/dash-infer
DashInfer is a native LLM inference engine aiming to deliver industry-leading performance atop various hardware architectures, including CUDA, x86 and ARMv9.
CApache-2.0
Stargazers
- 0x376h
- Arthesfan
- caojiachen1
- ccyhxg
- charloco
- daoxianBeijing, China
- DLUT-ZhengLi
- Epsilon314
- ggsonic
- huangfudeSuZhou
- huangjunxiancool
- huliangbing
- janicevidal
- jarviszeng-zjc
- kzjeefHangzhou
- laiwenzh
- leefigeChina
- leixy76
- linhao622
- littlewwwhitewuxi
- Lucius-THUTsinghua University
- ludaxianzhi
- MCZ777
- moshangchengChina
- shushanxingzheShenzhen
- thomas-yanxin@X-D-Lab @ColugoMum
- Tianyi-THUTsinghua University
- tongji1907
- wellpengwww.1218.com.cn
- Yeargod
- yjc9696
- yysu-888
- zhangheliAlibaba
- zhanpengjie
- zhouyuan@Intel
- zjd1988China