Why is training so slow and GPU utilization so low?
Evie-0808 opened this issue · 2 comments
Evie-0808 commented
When I use this code to train, why is the training speed so slow and the GPU utilization so low?
Nannigalaxy commented
Solved yet?
Even I'm facing the same issue. Transformers may not be optimized properly?
Sanjay1911 commented
Did you figure out a way to solve this? I'm currently training a custom mbnet-ssd and my training is super slow in L4 GPU and there is no utilization of GPU.
I've also set use-cuda to true and my log says Using CUDA