Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
Primary LanguagePythonMIT LicenseMIT