/text-generation-docker

Docker image for the Text Generation Web UI: A Gradio web UI for Large Language Models. Supports Transformers, AWQ, GPTQ, llama.cpp (GGUF), Llama models

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

Watchers