yasenh/libtorch-yolov5

Why is the detection speed slow on GPU？

Mrgao9 opened this issue · 2 comments

Mrgao9 commented

Dear author, I use yolov5s.pt to detect images. It takes 289 ms per frame on CPU and 127 ms per frame on rtx3070 graphics card. Why is it slow on GPU? Pytorch version yolov5 takes 11 ms per frame on rtx3070 graphics card。

I look forward to your help！

TongShuo-Demon commented

同样想问一下，为什么我在libtorch上面比pytorch还慢？

blackCmd commented
  • My env : Windows 10 + Quadro 8000.

So slow on GPU...... It about 10FPS
In Python version, the FPS is 45FPS.

image