Provide BatchingProcessor as a built-in processor
ocadaruma opened this issue · 3 comments
ocadaruma commented
- Task batching is a common-pattern that many Decaton users often implement by their own
- i.e. Batching several tasks of type
T
toList<T>
and process them at once. e.g. when downstream-DB supports batching I/O (which often very efficient) - Batch-flushing should be done in time-based and size-based.
- i.e. Batching several tasks of type
- So it's better to provide BatchingProcessor built-in to meet the common needs
ryamagishi commented
I'll try this issue.
ocadaruma commented
Thank you!
I assigned you.