GPU out of memory

[pyni]

Hi, Thanks for your code. I have met one problem.
when I run the coarse stage, it works.
But when I run the fine stage(even independently), it shows GPU out of memory :

I have tried to decrease the number of batch size (N_rand) in configs/default_fine_s.py, but it doesn't work.

Do you have any suggestions?
Thanks.

[wutong16]

Hi @pyni, sorry for the late reply.
Decreasing the N_rand or using a lower resolution for the grid here would alleviate the problem, while the results may also be affected at the same time. The OOM problem usually occurs at around 15,000 iters during the fine stage, where the grid resolution is upscaled to 256^3.