/PyramidKV

The Official Implementation of PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling

Primary LanguageJupyter NotebookMIT LicenseMIT

Watchers