cuda out of memory in V100 GPU (32GB)

Question

cuda out of memory in V100 GPU (32GB)

Closed this issue a year ago · 4 comments

Thank you for your work.
I would like to ask how much GPU memory is required to run this code.
I found that there will be errors on the 32G V100 GPU.

Looking forward to your reply.

daspartho commented a year ago

awesome!

Answer 1 · 2023-10-12T10:01:32.000Z

hmm that shouldn't happen- i had run this on google colab with way weaker GPU so something must be wrong! could you give me some more info on your run?

Answer 2 · 2023-10-12T10:11:56.000Z

the hugginface space for the project is running on a T4 small with 16GB VRAM

Answer 3 · 2023-10-12T11:03:07.000Z

Thanks for your reply.

I have known the cause of the out-of-memory problem. It's the image resolution.

I used your provided codes, and changed the image resolution,

img = Image.open('phone.jpg').resize((512,512))

now it works well.

Thank you again.