fkodom/yet-another-retnet
A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (https://arxiv.org/pdf/2307.08621.pdf)
PythonMIT
Stargazers
- AdamBear
- Amshaker
- anas-rzOakland University
- benbenbenbenbenben
- by2101
- commashyHKUST
- dailingjun
- darkman111a
- dmariko-yseop@yseop
- DongyeongkimHanam-si, Gyeonggi-do, Republic of Korea
- ericlin2022
- fkodomPlainsight
- fly51flyPRIS
- gisbi-kimNAVER LABS
- gj-raza
- GrahLnn
- JeffCarpenterCanada
- jhl-Det
- joennlaeETH Zürich
- jotonedevUniversità degli Studi di Udine
- KenyonYBaidu Inc.
- MHarris021Pachyderm
- NanguageWuhan
- NaturalStupidltyKyiv, Ukraine
- rmsmith251Phoenix, AZ
- SandalotsVolcanak
- sjYoondeltarSeoul
- snoop2headKAIST AI
- stereoplegic🧪Science🖌️Art🪄Magic
- syncdothSouth Korea | Hong Kong
- vegax87
- WailordHe
- wuzhaowzwzwz
- yhyu13Shanghai, China
- ZiyangSMcGill University
- Zuojianhao