Tensorflow Serving Deploy your prediction models using Tensorflow Serving and run queries using the supplied REST API. Related: Tensorflow Docker Model Server Tensorflow Serving REST API Tensorflow Tensorboard Distributed training with TensorFlow