/simpleLlama

A Simple webserver for generating text with exllamav2

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

Watchers