metafacture/metafacture-core

Exception occurs when more threads are used than documents exists

dr0i opened this issue · 0 comments

dr0i commented

Reported at hbz/lobid-resources#1030 (comment):

When more threads are used than documents exists a NullPointerException occurs.

When calling closeStream(), a NullPointerException appears. This stops the ETL process finishing correctly and results in loss of processed documents.
A workaround is to catch the Exception.
However, as this is a problem can occur everywhere, it would be nicer to somehow control this probably at the ObjectPipeDecoupler.
Also, to say the least, it's rather unexpected to use more threads than documents, it may happen.