how to implement new algorithm in this repo?
lumiere-ml opened this issue · 1 comments
lumiere-ml commented
now confused with this repo architech, want to know how can I implement new algo in this repo, such as pyramidKV
Azure-Tang commented
Hi, maybe this doc can help you https://github.com/kvcache-ai/ktransformers/blob/main/doc/en/injection_tutorial.md