When encountering a malformed line in an input file, log it and continue.
Opened this issue · 2 comments
docktermj commented
Is your feature request related to a problem? Please describe.
We've notice input files with lines that are malformed (i.e. CSV delimiters are corrupted by delimiters in the data itself)
Describe the solution you'd like
When the stream-producer encounters such an error:
- Log the error
- Continue reading the next records.
roncewind commented
How about added a command line option to log failed lines?
jamietypovsky commented
It is ok to log all of the information to an error log file.