Example of distributed tensorflow

Adapted from: Learning TensorFlow by Itay Lieder; Yehezkel S. Resheff; Tom Hope. Published by O'Reilly Media, Inc., 2017.

Latest

To train with 3 workers and 1 parameter server in four processes, run:

python run_updated.py

Monitor progress in another terminal with:

watch -n 2 "ps aux | grep [p]ython"

And remember to close the parameter server after all the workers terminate:

kill -9 PID

python run_original.py