/text-generation-webui

A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

Primary LanguagePythonGNU Affero General Public License v3.0AGPL-3.0

This repository is not active