/quantkit

cli tool to quantize gguf, gptq, awq, hqq and exl2 models

Primary LanguagePythonMIT LicenseMIT

Watchers