bakwc/PySyncObj

Syncing objects with selected few servers

psmlbhor opened this issue · 2 comments

I am trying to write a distributed application in which I want the leader to get status of data from followers and sync the missing data with them. Now I can just use @replicated decorator to replicate a dictionary across all the nodes in the cluster. The problem is that, the data that has to be synced might be up-to 1 GB. If I just put my data inside the replicated dictionary, it will be replicated across all nodes and this will add unnecessary delay. I was wondering if it is possible to replicate data objects with specified nodes. It is acceptable if other nodes in the cluster have stale values of the data.

I would try creating a class specific to the servers you want to replicate the data with.

bakwc commented

We don't plan to add this functionality. The main idea is to replicate everything, if you need partitial replication - you need some other solution.