/RESNET_TINY_IMAGENET

Primary LanguageJupyter Notebook

RESNET_TINY_IMAGENET

HOW TO RUN:

Each folder has a batch file.

To run the experiment for non distributed training for example

cd non_distribute

sbatch batch.sh

To run the experiment of Data Parallel (ddp) for example

cd dataparallel

sbatch dparallel.sh

To run the experiment of Model Parallel for example

cd ModelParallel

sbatch mparallel.sh

HARDWARE REQUIREMENTS:

For Data Parallel:

image

For Model Parallel:

image

image

image

image

image