Quentin-Anthony opened this issue 7 months ago · 1 comments
https://github.com/microsoft/DeepSpeed/tree/master/blogs/deepspeed-ulysses
microsoft/Megatron-DeepSpeed@a2a476e