May I ask about the computing sources required?

Question

May I ask about the computing sources required?

suoych opened this issue 2 years ago · 2 comments

Hi, thanks for sharing your work.
May I ask how many GPUs (or the memory) it takes to train the baseline and how long the training procedure lasts for each category of tasks?

Answer 1 · 2022-11-16T17:07:29.000Z

Hi suoych,

I have replied to your email. As I mentioned in the paper, I trained the model with 8 DDP A5000 GPUs and run ~2 hours each. I used batch size 16 since I found small batch sizes might cause errors.

Answer 2 · 2022-11-17T05:24:19.000Z

Hi suoych,

I have replied to your email. As I mentioned in the paper, I trained the model with 8 DDP A5000 GPUs and run ~2 hours each. I used batch size 16 since I found small batch sizes might cause errors.

Thanks!