wei-potato/Train-llm-from-scratch
使用deepspeed从头开始训练一个LLM,经过pretrain和sft阶段,验证llm学习知识、理解语言、回答问题的能力
Python
Stargazers
- 17737787811
- a1010927919
- bonpreuCognizant
- DLFELICECopenhagen, Denmark
- DodgeHoHong Kong, SAR
- Ezan1245
- FengSTK
- FILAAC
- hanhyalex123
- hei-lou
- hjchen-thuShanghai
- hmcs666
- hookshoutSusquehanna International Group
- Hope-Diamond
- jambestwickyxy
- jiewaikexue
- juggernautMLShenzhen
- keithwym西北民族大学
- LongerShoreman13 Ward
- MagNumberBallmer Group
- Matterporter苏州
- mayunlin
- Mitsuizzz
- Remia-wrq
- RockNetyLitecoin
- ryokooooo4399
- SpicygumL上海
- StevenNealDallas, TX
- TheLiyo
- wannatureZhejiang University
- wei-potato
- WinDB3llState Ltd.
- Y77CH
- yujiaaoyu
- Yukiekiekie
- yzc2020HangZhou