/GPTQ-for-LLaMa-API

Provide a way to use the GPT-QLLama model as an API

Primary LanguagePythonApache License 2.0Apache-2.0

Watchers