/aphrodite-engine

Large-scale LLM inference engine

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

Stargazers