Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking the Positional Encoding in Language Pre-training".
Primary LanguagePythonMIT LicenseMIT
No issues in this repository yet.