Pytorch_MultiGPU
Single-GPU
python 1_trainer_SingleGPU.py
Multi-GPU (DP)
python 2_trainer_DP.py
Multi-GPU (DDP)
python -m torch.distributed.launch --nproc_per_node 4 3_trainer_DDP.py
python 1_trainer_SingleGPU.py
python 2_trainer_DP.py
python -m torch.distributed.launch --nproc_per_node 4 3_trainer_DDP.py