MatthewCroughan/PowerInfer
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
C++MIT
Stargazers
No one’s star this repository yet.
High-speed Large Language Model Serving on PCs with Consumer-grade GPUs
C++MIT
No one’s star this repository yet.