KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Primary LanguagePythonMIT LicenseMIT
No issues in this repository yet.