google-deepmind/randomized_positional_encodings
Randomized Positional Encodings Boost Length Generalization of Transformers
PythonApache-2.0
Stargazers
- akhichit2008@davbgpm @Akhi-Code-AI
- alexeygolyshevRussia
- AndreasKaratzasSoftware/Hardware co-design for Deep Learning
- atuxhe
- crack521
- czy97Shanghai Jiao Tong University
- fakufakuLINE Corporation
- fly51flyPRIS
- giganttheoParis
- GitHub30Osaka, Japan
- gyunggyung@forus-ai
- gzhu06University of Rochester
- howaboutyu
- hundredeuk2Hanyang Univ. BIS Lab
- L1aoXingyuBeijing, China
- MARD1NOSiliconFlow
- menegazzi
- miketrimmelVienna
- moskomuleRIKEN AIP
- Murplugg
- nandwalritikEarth
- nawnoesSeoul, Korea
- qgzangUSTC
- RaysilienceCollege Station, Texas 77840
- RicherMansXiaomi
- SandalotsVolcanak
- shoegazerstella@musixmatch @musixmatchresearch
- stefan-itBavarian Oberland, Germany
- Takaaki-SaekiGoogle
- toberain
- tosi-nUnited Kingdom
- twelveand0
- useCallback@3M-Zone
- windar427shanghai
- xISSAx
- ZeroCool2u@FRBNY