Question : About writer line by line
old741 opened this issue · 1 comments
old741 commented
Hello ,
i use v5.3.0
Is it possible to write line by line instead of loading all into memory and writing it batch by batch in csv file at the end ?
If possible how do it ?
Thanks
fmbenhassine commented
Hi,
You can do that by setting the batch size to 1, see job configuration. The idea of bulk writes is to flush records in batches instead of one by one for better performance (jdbc batch updates is the typical use case).