What's the gpu device that can support this model?

Question

clownrat6 opened this issue 3 years ago · 4 comments

Is the batch size 128? I can't deploy the model on single 11 GB NVIDIA 2080 Ti when setting batch size is 16.

Answer 1 · 2021-10-04T08:47:42.000Z

Hi,

The model is trained with V100. You can use smaller batch size when training with 11GB 2080Ti.

Answer 2 · 2021-10-22T15:14:37.000Z

Thank you. I get it. The batch size will be assigned to each gpu. So the samples of one gpu is batch_size / num_gpus

Answer 3 · 2021-11-04T01:41:47.000Z

Hi,

The model is trained with V100. You can use smaller batch size when training with 11GB 2080Ti.

Dear author, how many V100 do you use to train the models?

Answer 4 · 2022-02-13T03:19:28.000Z

1080Ti * 4 is also ok. But 3090Ti isn't.