Something about the training .
Closed this issue · 3 comments
linjing7 commented
Hi, thanks for your excellent work. I wonder that will it save some time if I change the "trainer_mode" from "dp" into "ddp"? I have 4 GPUs and it seems that it did not speed up ~
zzh-tech commented
Yes, the ddp mode in this code repository cannot work correctly.
It should be rewritten and the dataset in lmdb format will cause some problems.
linjing7 commented
Okay, I'll try to rewritte it.
lyw3074 commented
Okay, I'll try to rewritte it.
Hi, could you share the rewritten ddp code?