SCAC strategy for efficient and effective KV cache eviction in LLMs
Primary LanguagePythonMIT LicenseMIT