weiaicunzai/pytorch-cifar100

Multiple GPUs

JanineCHEN opened this issue · 2 comments

JanineCHEN commented

Great thanks for sharing the codes!

One question, does the training support multiple GPUs? Kindly correct if I am mistaken, but as far as I can tell, the codes only support single GPU now?

weiaicunzai commented

My code doesn't support multi GPU, sry, I think you could slightly modify the code to support multi gpu training:
example:

net = nn.DataParallel(net, device_ids=args.gpus)

The pytorch nn.DataParallel could easily make your code to support multi GPU training
docs: https://pytorch.org/docs/stable/generated/torch.nn.DataParallel.html

JanineCHEN commented

My code doesn't support multi GPU, sry, I think you could slightly modify the code to support multi gpu training:
example:

net = nn.DataParallel(net, device_ids=args.gpus)

The pytorch nn.DataParallel could easily make your code to support multi GPU training
docs: https://pytorch.org/docs/stable/generated/torch.nn.DataParallel.html

Thank you! I have tried and it works.