/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Primary LanguagePythonOtherNOASSERTION

No issues in this repository yet.