/fsdl-megatron

Code for FSDL Breaking down parallelism in Megatron-LM

Primary LanguagePythonMIT LicenseMIT

Stargazers