/AutoGPTQ-API

Host the GPTQ model using AutoGPTQ as an API that is compatible with text generation UI API.

Primary LanguagePython

Stargazers

No one’s star this repository yet.