CoinCheung/gdGPT
Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.
PythonApache-2.0
Stargazers
- balachandarsvZoho Corporation
- bbo0924
- BeomiSeoul, South Korea
- bigcashmaimeng
- brunomaga@microsoftresearch
- curiosity92
- cwszz
- DebouterShanghai Jiao Tong University
- DerrickWang005The University of Sydney
- flow3rdownZhejiang Univeristy, Tencent
- fly51flyPRIS
- GeneZC
- gmftbyGMFTBYBeijing Institute of Technology
- icodingcKuaishou、SenseTime
- IT-xiaobai
- Jingsong-YanSouth China University of Technology
- l878619717
- lichen914
- LuckyyySTA
- mortal-ZeroIllinois Institute of Technology
- oneal2000
- panyuyang
- ravindra-ut
- ReverseSystem001
- sooftware@tunib-ai
- SparkJiaoNTU-NLP & I2R, A*STAR, Singapore
- starrywinterskyTencent
- TING2938China
- tqfangLausanne, Switzerland
- weidong2018FDU
- Wind508
- WuJian1995Titech
- xczas
- yetianshThe University of Hong Kong
- yuyaxiong
- yyyyyt123Hong Kong