optuna/optuna-examples

Optuna DDP with Slurm Cluster

asifmustafa87 opened this issue · 1 comments

asifmustafa87 commented

I was wondering if there is any example for optuna hyperparameter tuning with multi gpu ddp for hyper parameter optimization in Slurm Cluster bacause I could not find one.

nzw0301 commented

As you can see in this repo, no. Optuna's github action does not use GPUs, so slum with GPUs would not be available soon.