dmlc/parameter_server

Error on make

chiggum opened this issue · 3 comments

I got this error while making the project :
./box/item.h:43:14: error: there are no arguments to ‘IsRoot’ that depend on a template parameter, so a declaration of ‘IsRoot’ must be available

mli commented

Thanks for pointing it out. The class Item will be depressed because we have a better way to send commands between clients and servers. In fact, we are developing a quite difference but much better version on another repository, and will update this one soon. Please have a check later.

That's great.. I have been studying about using distributed systems for scaling machine learning problems. I came across this paper "Parameter Server for Distributed Machine Learning" and have gone through it a few times. I understood the basic idea and now want to know about it even more. Can you provide me with the link to the repo over which its modified version is being built on.
Thanks..

mli commented

We are developing on a private github, and will make it public once the codes are in a good shape. I do not suggest you to read the current codes now, because we may greatly change the architecture in this month. If you are interested, I could ping you if the new version is ready.

For distributed machine learning systems, I suggest you to look at MPI (a traditional way people write distributed applications), Graphlab (quite successful on graph computing), and Spark (in memory hadoop, quite fast if the data is in a good shape).