Feature Request Fix DDP torch.jit.trace cannot be pickled

Question

Feature Request Fix DDP torch.jit.trace cannot be pickled

Closed this issue 4 years ago · 2 comments

Currently, torch.jit.trace can't be pickled with multiprocessing.spawn. To fix this, it is better to use subprocess.Popen instead.

Answer 1 · 2020-04-18T02:30:28.000Z

subprocess.Popen is not compatible with jupyter notebook. A better solution is to use cloudpickle instead of the default pickle to serialize the arguments

Answer 2 · 2020-04-19T05:54:47.000Z

cloudpickle also can't pickle torch._C.ScriptFunction