EleutherAI/oslo

coloDDP integration

dongsungkim opened this issue · 1 comments

dongsungkim commented

Describe a TODO feature

  • Need to integrate coloDDP for patricstar and zeroDDP
  1. Port coloDDP class
  2. add test code for coloDDP

Assignees

  • Dongsung Kim
dongsungkim commented

Done