dmlc/ps-lite

Is there an implementation of matrix transport based on ps-lite?

hbsun2113 opened this issue · 4 comments

For a k-v pair, the v is a matrix. In other words, it is not necessary to assign a key to every element in the matrix. Is there an implementation of matrix transport based on ps-lite?

in ps-lite, v is already a matrix. what do you mean by matrix transport?

in ps-lite, v is already a matrix. what do you mean by matrix transport?

If a v is a matrix, then the matrix will be stored on only one server. I want the matrix to be stored on multi servers(In other words, different part is stored on a different server). I think it will reduce the communication cost.

You can control the granularity, by splitting a matrix into multiple keys and spreading these keys to multiple servers

You can control the granularity, by splitting a matrix into multiple keys and spreading these keys to multiple servers

Yeap! But I think ps-lite should provide the API for the general case like load-balance.