Duplicate output folders when using DDP
SeanNaren opened this issue · 1 comments
SeanNaren commented
🐛 Bug
This is described in Lightning-AI/pytorch-lightning#5512
As a stopgap, we could just reduce the granularity of the run.dir by removing the seconds. This would make all processes use the same run dir in most cases, unless you're unlucky and get caught in the middle of a minute....
SeanNaren commented
Fixed upstream!