EleutherAI/oslo

pass optimizer parameters

minqukanq opened this issue 2 years ago · 2 comments

minqukanq commented 2 years ago

Describe a TODO feature

Passing multiple parameters to ZeroRedundancyOptimizer

Assignees

@minqukanq

hyunwoongko commented 2 years ago

And could you test Zero optimizer wirh fsdp?

minqukanq commented 2 years ago

@hyunwoongko I tested it but it didn't solve the issue. :(