An OAI compatible exllamav2 API that's both lightweight and fast
Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0
No one’s star this repository yet.