A Simple webserver for generating text with GPTQ-For-Llama
Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0