/lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

Primary LanguageC++Apache License 2.0Apache-2.0

Stargazers

No one’s star this repository yet.