/infini-transformer

PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" (https://arxiv.org/abs/2404.07143)

Primary LanguagePythonMIT LicenseMIT

Watchers

No one’s watching this repository yet.