Netflix/hollow

Synchronized between consumers may slow down Hash Index reindex?

adwu73 opened this issue · 1 comments

Hi, there:
First, thanks for this great product! We are building an advanced version of trello, have very flexible filtering capabilities using Hollow. Now we have a customer who has 1000 people using this tool to manage their daily developement work.

However, we are faceing some slow HashIndex reindexing issue in the morning time, when every one is using this tool.

We have a card server that is producing hollow delta every seconds, and a view server get delta update via nfs and reindex Hash Index every second. we have 30 Hash Index under card consumer, Under the heavy load, we found that Hash Index reindexing may take several minutes even after we can see the data updated through explorer, but the new data won't be available after the reindexing finished.

We found the updateTo method is marked as synchronized, the will block other consumers from update in the heavy load situations? We want to know whether this synchronized keyword can be removed?

image

Regards!

Adam

can we remove this synchronized keyword here?