Multi-node parameter server
Closed this issue · 1 comments
jsjason commented
A parameter server that consists of only one node is very likely to be a computation bottleneck, and can be viewed as a single point of failure that makes the whole job fail when a server fault happens. We need to implement a parameter server that is backed by multiple nodes.
bchocho commented
I'd like to take a look at this issue.