trt_engine_nodes in TensorRT graph: 0
ruyijidan opened this issue · 4 comments
TensorRT model is successfully stored!
numb. of all_nodes in frozen graph: 8016
numb. of trt_engine_nodes in TensorRT graph: 0
numb. of all_nodes in TensorRT graph: 882
I don’t know why the model have no TensorRT graph and the trt model FPS is the same as original‘s.
at UBUNTU1804 1080TI tensorRT=5.1.5.0 tensorflow==1.14.0
I also encountered the same problem
I was thinking that maybe tenflow did not successfully use tensorrt
Environment :
ubuntu1604; 2080ti; TensorRT=5.1.5.0; tensorflow==1.14
@float123
Environment :ubuntu1804 python3.5.6 cuda10.0 cudnn7.5.1.10 Tensorflow1.13,.1 TensorRT5.1.5.0
WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work
TensorRT model is successfully stored!
numb. of all_nodes in frozen graph: 8016
numb. of trt_engine_nodes in TensorRT graph: 18
numb. of all_nodes in TensorRT graph: 73
FYI
@float123
Environment :ubuntu1804 python3.5.6 cuda10.0 cudnn7.5.1.10 Tensorflow1.13,.1 TensorRT5.1.5.0WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work
TensorRT model is successfully stored!
numb. of all_nodes in frozen graph: 8016
numb. of trt_engine_nodes in TensorRT graph: 18
numb. of all_nodes in TensorRT graph: 73FYI
thank you，I use tensorflow1.13.1 and tensorrt5.0.2.6, but fps also not improve significantly.
@float123
Environment :ubuntu1804 python3.5.6 cuda10.0 cudnn7.5.1.10 Tensorflow1.13,.1 TensorRT5.1.5.0
WARNING:tensorflow:TensorRT mismatch. Compiled against version 5.0.2, but loaded 5.1.5. Things may not work
TensorRT model is successfully stored!
numb. of all_nodes in frozen graph: 8016
numb. of trt_engine_nodes in TensorRT graph: 18
numb. of all_nodes in TensorRT graph: 73
FYIthank you，I use tensorflow1.13.1 and tensorrt5.0.2.6, but fps also not improve significantly.
The same as you,But I use my laptop,fps from 10 upto 18~19(GPU 970M),