nawnoes/pytorch-gpt-x
Implementation of autoregressive language model using improved Transformer and DeepSpeed pipeline parallelism.
Python
Stargazers
- asyncmind0@DamageBDD
- BeyonderXXFudan University
- ChaoqiLiang
- ChoongwonPark
- cnxupupup
- coderpro213
- fedaeho
- fly51flyPRIS
- forrestbingAlibaba Inc
- grassesPhD@ZJU
- hassiahkMercedes-Benz R&D India
- hugoycjthe Chinese University of Hong Kong, Shenzhen
- hyeneeChungnam National University
- hyunwoongko@kakao
- jinmang2Republic of Korea
- kbakdevPoland
- KyeongpilScatter Lab
- lichao-wu9
- loofahcus01.ai
- MrBananaHuman
- priyankarkMicrosoft
- sirzzangInnodep Inc.
- sooftware@tunib-ai
- tallesairanairanDev
- thisisanshguptaIndia
- tuwan88
- upskyyReturnZero Inc.
- valuenumbering
- Xie-Minghui
- xuanhan863Los Angeles, USA
- XZK9Beijing
- yunpeng-maKarlstad University