lnx-search/datacake

Avoid sending duplicate RPC calls during the background distribution task

ChillFish8 opened this issue · 0 comments

Currently, datacake's eventual consistency module will send operations in batches to all nodes in the background, but this is in efficient when we're sending operations that a node might have already replied to and acknowledged.

Improving this cuts out some additional RPC calls in situations with a small number of nodes:

3 nodes with Consistency::Quorum will result in at least 3 RPC calls (1for the quorum, 2 for the background task)
this can be easily made into 2 and this scales as the consistency level is increased and the number of nodes increases.