bigscience-workshop/Megatron-DeepSpeed

Hello, can Megatron-DeepSpeed pre-train llama2?

13416157913 opened this issue · 0 comments

13416157913 commented

Hello, can Megatron-DeepSpeed pre-train llama2?
Can give a sample script?