/Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Primary LanguageJupyter NotebookOtherNOASSERTION

No issues in this repository yet.