/PowerInfer

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Primary LanguageCMIT LicenseMIT

Stargazers

No one’s star this repository yet.