No speed improvements after TF-TRT optimizing on a tensorflow BERT model
SohaKhazaeli opened this issue · 0 comments
SohaKhazaeli commented
After optimizing the model with either FP32 or FP16 I don't get any speed improvements.
The optimization is done on tensorflow/tensorflow:2.10.0-gpu docker image. The model uses tensorflow-text and tf-models-official libraries
This is the log from optimization process:
