clusterpedia-io/clusterpedia

Add message queue to implement multi-cluster watch interface When using the default storage layer

wuyingjun-lucky opened this issue · 3 comments

What would you like to be added?

Add message queue to implement multi-cluster watch interface When using the default storage layer

Why is this needed?

Improve Clusterpedia Query capability (dynamic query)

Hi @wuyingjun-lucky,
Thanks for opening an issue!
We will look into it as soon as possible.

Details

Instructions for interacting with me using comments are available here.
If you have questions or suggestions related to my behavior, please file an issue against the gh-ci-bot repository.

image

hi, this is our solution for the multi-cluster watch feature.

  1. A message queue is used for transporting events from ClusterSynchroManager to ApiServer, before transporting, events must be persisted to the storage layer, and rv of events must be converted to multi-clusters-rv.
  2. EventCache is a buffer for newest events whose number is limit to 100 by default.
  3. we have defined a series of universal inferfaces for message queue middleware. And we have introduced RabbitMQ by implement the interfaces.