need a queue to cache logs

Question

Closed this issue 2 years ago · 3 comments

the performance is not good enough,
maybe better to add a queue to cache more logs and write to db once for all.

Answer 1 · 2022-09-25T23:57:56.000Z

The current sink uses PeriodicBatchingSink which does batching and queuing.

If you feel you have a better method, feel free to submit a Pull Request.

Answer 2 · 2022-09-26T00:08:12.000Z

Latest adds the ability to configure the "Insert Options" for MongoDb. So you can turn off Validation and it should be faster:

cfg.ConfigureInsertOptions(s => s.BypassDocumentValidation = true);

Answer 3 · 2022-09-26T00:12:46.000Z

That feature is in v5.2.2 -- closing this issue for now.