What is the approximate amount of GPU memory needed for this model?
Gray1308 opened this issue · 0 comments
Gray1308 commented
I tried to train the model on a computer with 13G of GPU memory, but it kept reporting errors out of memory. A debug shows that each forward() causes the memory usage to increase and not decrease. I have not changed any code, is this normal?