Warning: This repo is now unmaintained and unnecessary.
Use the official tensorflow/serving
Docker images instead: https://hub.docker.com/r/tensorflow/serving
Tensorflow binaries and Docker images compiled with GPU support and CPU optimizations.
We now pull optimized Tensorflow wheels from mind/wheels rather than building our own.
Updating Tensorflow version
When a new version of Tensorflow is released:
Update the versions at the top of script/distribute*
.
On a very powerful machine with Docker, set $GITHUB_TOKEN
to a GitHub access token with repo permissions and run script/distribute-binaries
(seriously, crank the CPU all the way up if using the cloud).
Update the binary links below from https://github.com/triagemd/tensorflow-builds/releases .
Push to master.
Docker builds
Binary
Tensorflow Serving 1.7:
CPU optimized, with Intel MKL
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.7.0/tensorflow_model_server_optimized
GPU, CUDA 9.0, without CPU optimization
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.7.0/tensorflow_model_server_gpu
GPU, CUDA 9.1, with CPU optimization, with Intel MKL
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.7.0/tensorflow_model_server_optimized_gpu
Tensorflow Serving 1.6:
CPU optimized, with Intel MKL
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.6.0/tensorflow_model_server_optimized
GPU, CUDA 9.0, without CPU optimization
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.6.0/tensorflow_model_server_gpu
GPU, CUDA 9.1, with CPU optimization, with Intel MKL
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.6.0/tensorflow_model_server_optimized_gpu
Tensorflow Serving 1.5:
CPU optimized, with Intel MKL
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.5.0/tensorflow_model_server_optimized
GPU, CUDA 9.0, without CPU optimization
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.5.0/tensorflow_model_server_gpu
GPU, CUDA 9.1, with CPU optimization, with Intel MKL
https://github.com/triagemd/tensorflow-builds/releases/download/tf-serving-1.5.0/tensorflow_model_server_optimized_gpu
Docker image
Python + Intel MKL-DNN:
python2.7-mkl
python3.6-mkl
Python + CUDA:
python2.7-cuda9.0
python3.6-cuda9.0
python2.7-cuda9.1
python3.6-cuda9.1
Python + CUDA + Intel MKL-DNN:
python2.7-cuda9.1-mkl
python3.6-cuda9.1-mkl
Tensorflow:
python2.7-tensorflow
python3.6-tensorflow
python2.7-tensorflow-gpu
python3.6-tensorflow-gpu
Tensorflow with CPU optimizations:
python2.7-tensorflow-optimized
python3.6-tensorflow-optimized
python2.7-tensorflow-optimized-gpu
python3.6-tensorflow-optimized-gpu
Tensorflow Serving:
python2.7-tensorflow-serving
python2.7-tensorflow-serving-optimized
python2.7-tensorflow-serving-gpu
python2.7-tensorflow-serving-optimized-gpu