yuzhaouoe/pretraining-data-packing
[ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
PythonMIT
Stargazers
- chklaUMannheim & UCologne
- denisfitz57
- Hannibal046Peking University; intern@DeepSeek
- kascasBeihang University
- l0he1g中国
- MarshtompCS
- ohsuz
- RunxinXuPeking University
- Ryu1845
- shoaibahmedUniversity of Cambridge
- simonEllershawRoam
- syzymonUniversity of Warsaw
- tongyao-zhuNational University of Singapore
- WANGXinyiLindaUCSB
- yotamnahum@Samplead
- Yunxuan-Xiao-DavianHKUST(GZ)
- yuzhaouoe