/LLM-Pretraining-Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Primary LanguagePythonOtherNOASSERTION

Watchers

No one’s watching this repository yet.