xxcheng0708/pytorch-model-train-template
pytorch单精度、半精度、混合精度、单卡、多卡（DP / DDP）、FSDP、DeepSpeed模型训练代码，并对比不同方法的训练速度以及GPU内存的使用
Python
Stargazers
- aidings
- AnAppleCoreIDG/McGovern Institute, Tsinghua University
- ByronnarECNU
- Charrify
- CNSaintNeo
- cxmscb
- debbo2011
- flower-kyo
- fly51flyPRIS
- fwyc0573
- hxf1228Huazhong University of Sci. and Tech.
- jiashu-z
- jugg1024
- Liangzheng-ZLShanghai Jiao Tong University
- loserofeverythingHarbin,Heilongjiang,China
- M-SunRiseAnhui University
- NorthrendShanghai, China
- Ozone-ooChongqing University
- qihang-zou
- sdu-huanhqJinan, Shandong, China
- teddyluoChengdu, China
- tomatobobotUnited States
- trialbox
- wcg49802693
- wm901115nwpu
- wudongming97Beijing Institute of Technology
- wukailuTsinghua University
- XiaochaosuiGo Further.AI
- xiaofof
- xxcheng0708
- yfChang-cvCASIA
- yihaosun1124Nanjing University
- yuboonaNUDT Master | CUG Bachelor
- zgf-RS
- ZhikangNiuXidian Univeristy
- zichuan-liuMSc at Nanjing University | Formerly Interned at Microsoft Reaseach Asia and Alibaba DAMO Academy