Difference between DataParallel and DistributedDataParallel?
zpge opened this issue · 1 comments
zpge commented
Hi,
Nice work. I have a question. What is the difference between resnet_imagenet_DataParallel_train_example and resnet_imagenet_DistributedDataParallel_train_example?
zgcr commented
Hi,
Nice work. I have a question. What is the difference between resnet_imagenet_DataParallel_train_example and resnet_imagenet_DistributedDataParallel_train_example?
Non-distributed training mode and distributed training mode.