[ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.
Primary LanguagePythonMIT LicenseMIT