zero-1
There are 1 repositories under zero-1 topic.
xrsrke/pipegoose
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
There are 1 repositories under zero-1 topic.
Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*