My GPU is barely under load, but my CPU is at 50% while training

Question

My GPU is barely under load, but my CPU is at 50% while training

pavelhamburh opened this issue 5 months ago · 1 comments

Is the training supposed to use only the GPU's memory and none of its computational power? Because my CPU is under a lot of stress (about 50%), while my GPU (4090) shows 0% usage; only the memory is being utilized. Or did I install some requirements incorrectly?

Answer 1 · 2024-04-20T12:26:44.000Z

upd: installed CUDA 11.8 and a relevant torch, vent from 30 sec/it to 1 sec/it

see this repo:
https://github.com/HUANGYming/DIS-A100-4090