nikepan/clickhouse-bulk

How to guarantee data reliability?

2hangchen opened this issue · 3 comments

The data will multi in memory, and if the service dead when the data is saved too much, the data will be lost

You can set a short dispatch period. There are currently no ways to increase reliability.

All tools are made for their tasks. Those who need reliability can afford to write for their tasks. This utility is needed more for collecting site statistics on python and php and can afford to lose a second of data.

All tools are made for their tasks. Those who need reliability can afford to write for their tasks. This utility is needed more for collecting site statistics on python and php and can afford to lose a second of data.

Yes, I think we have to find a way to minimize the damage