/lightning-attention

Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models

Primary LanguagePythonMIT LicenseMIT

Stargazers