/attention_with_linear_biases

Code for the ALiBi method for transformer language models

Primary LanguagePythonMIT LicenseMIT

No issues in this repository yet.