/slurm-pytorch-ddp-boilerplate

A boilerplate for seamlessly integrating PyTorch's Distributed Data Parallel (DDP) with SLURM job scheduling and Weights and Biases. Kickstart your scalable deep learning projects on HPC clusters.

Primary LanguagePython

Stargazers