[ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Primary LanguagePythonMIT LicenseMIT