Distributed Training?
Opened this issue · 1 comments
philschmid commented
Does Q-Galore work with FSDP or DS?
skyshine102 commented
Same question.
I saw dist in the script. It's not imported by original galore adam8bit.
Opened this issue · 1 comments
Does Q-Galore work with FSDP or DS?
Same question.
I saw dist in the script. It's not imported by original galore adam8bit.