RuntimeError: Default process group has not been initialized, please make sure to call init_process_group.

Question

RuntimeError: Default process group has not been initialized, please make sure to call init_process_group.

Opened this issue 4 years ago · 5 comments

qhq123 commented 4 years ago

when i run the run_20news.py,occur this mistake

Answer 1 · 2021-08-23T08:52:17.000Z

soultion: pytorch/pytorch#22538

Answer 2 · 2022-06-14T08:02:30.000Z

soultion: pytorch/pytorch#22538

does it mean we should add a dist.init_process_group('gloo', init_method='file:///tmp/somefile', rank=0, world_size=1) inside main_loop.py? But what should we pass in for init_method?
and the wierd thing is I am training on 1 gpu 1 machine, why a parallel or distributed problem occur?

Answer 3 · 2023-07-11T10:18:46.000Z

soultion: pytorch/pytorch#22538

does it mean we should add a dist.init_process_group('gloo', init_method='file:///tmp/somefile', rank=0, world_size=1) inside main_loop.py? But what should we pass in for init_method? and the wierd thing is I am training on 1 gpu 1 machine, why a parallel or distributed problem occur?

Have you solved this problem？

Answer 4 · 2023-07-11T10:25:23.000Z

when i run the run_20news.py,occur this mistake

Have you solved this problem？

Answer 5 · 2023-10-16T08:54:55.000Z

請問有人解決這個問題了嘛