- Convert your model files (h5) into a frozen graph using the freeze graph code
- Run the optimize script to get a new graph with tensorrt operations
- Install necessary cuda and cudnn libararies. (I got success with cuda-9.0 and cudnn-7.0)
- Install TensorRT from official repos (Building from source works too)
- Build tensorflow from source and enable TensorRT support in configuration script.