turboderp-org/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
PythonMIT
Stargazers
- 04RRBITS PIlani, Goa Campus
- 0zlSumedang, Indonesia
- antiven0mUSA
- bartowski1182
- bitnomUSA
- bmilde
- brandon-lockabyGreenville, SC
- carteakeyToronto, Ontario
- chenhunghanTaiwan
- chrisbwardLondon, England
- curtisgray
- CyberTimonCyberTimon
- DaveidWeba
- dvdtoth✈
- epicfilemcnultyKyiv, Ukraine
- ice0
- IndieMinimalist
- Khreas
- kiuckhuangHSBC
- krzysiekpodk
- LluisTrillaClaitec
- maciejbrasewicz
- MarcBauer-LM
- McCoubreym
- nikosoikThessaloniki
- Ovoj
- Panchovix
- sandwichdogeSài Gòn
- sangkilpark-kidmam
- sjYoondeltarSeoul
- TechnotechGit
- tsanders
- turboderp
- yifever
- ziozzangSeoul, Korea
- zxybazhApple