azuki-miho/RFCR

Resource exhausted error

Opened this issue · 1 comments

I'm working on S3DIS dataset (4.8GB) with all pre requisites installed. Running Ubuntu 18.04 with GTX 2080 and 16gb ram.

After training model, it shows at some point error- Resource exhausted error: OOM when allocating tensor with shape [1029, 33 ,64].....

Maybe memory is exhausted.

How to resolve this issue.

Additionally, instructions use a single GPU, GPU visible 0. Can I use my 2 GTX 2080 parallelly?

Training over multiple GPU is not supported currently. I suggest using 1080Ti or 2080Ti for training. If you only have 2 GTX 2080, I recommend you lower down the batch size.