/InfiniTransformer

Unofficial PyTorch/🤗Transformers(+Gemma) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Primary LanguagePythonMIT LicenseMIT

No issues in this repository yet.