zgcr/SimpleAICV_pytorch_training_examples

Difference between DataParallel and DistributedDataParallel?

zpge opened this issue · 1 comments

zpge commented

Hi,
Nice work. I have a question. What is the difference between resnet_imagenet_DataParallel_train_example and resnet_imagenet_DistributedDataParallel_train_example?

zgcr commented

Hi,
Nice work. I have a question. What is the difference between resnet_imagenet_DataParallel_train_example and resnet_imagenet_DistributedDataParallel_train_example?

Non-distributed training mode and distributed training mode.