No speedup after convert to tensorrt (all operator is conv2d and conv2dtranspose)
dathudeptrai opened this issue · 1 comments
dathudeptrai commented
Hi, i convert my model to tensorrt using tf-tfrt but the speed is the same as original tensorflow saved model. Pls, help me check, bellow is my code. Thanks so much.
https://colab.research.google.com/drive/1qD5kZ_EUxeG2AaQHpTSn7RE7OkRh1CHl#scrollTo=sqrFO_tCtbft.
Maybe i wrong something when convert my model to tensorrt, i don't have local GPU so i just can test it on google colab, so if possible, please help me fix it on google colab. I also test resnet50 and the speed is around 2x faster but failed on my model.
dathudeptrai commented
@tfeher can u take a look ?