Exception occurs when more threads are used than documents exists
dr0i opened this issue · 0 comments
dr0i commented
Reported at hbz/lobid-resources#1030 (comment):
When more threads are used than documents exists a NullPointerException
occurs.
When calling closeStream()
, a NullPointerException
appears. This stops the ETL process finishing correctly and results in loss of processed documents.
A workaround is to catch the Exception.
However, as this is a problem can occur everywhere, it would be nicer to somehow control this probably at the ObjectPipeDecoupler.
Also, to say the least, it's rather unexpected to use more threads than documents, it may happen.