/fsdl-megatron

Code for FSDL Breaking down parallelism in Megatron-LM

Primary LanguagePythonMIT LicenseMIT

fsdl-megatron

Code for FSDL Breaking down parallelism in Megatron-LM