memory cost

Question

memory cost

Closed this issue a year ago · 2 comments

Thanks for your nice work !
May I ask how much video memory is required?
Best wish~

Answer 1 · 2023-09-16T21:03:52.000Z

Thanks for your interest in our work.
I am not sure what do you mean by "video" memory, but if you are referring to GPU memory, it totally depends on the batch size you use. For ImageNet experiments, with batch size of 512 on ViTB-B-16, it might require 3 A*6000 GPUs.

Answer 2 · 2023-09-17T03:01:06.000Z

Thanks for your interest in our work. I am not sure what do you mean by "video" memory, but if you are referring to GPU memory, it totally depends on the batch size you use. For ImageNet experiments, with batch size of 512 on ViTB-B-16, it might require 3 A*6000 GPUs.

sorry for my mistake.It actually is GPU memory I mean.
Thanks you~
Best wish~