/IntactKV

Official PyTorch implementation of IntactKV: Improving Large Language Model Quantization by Keeping Pivot Tokens Intact

Primary LanguagePythonMIT LicenseMIT

Stargazers