Consider not attempting to load huge history files into raw table
Closed this issue · 0 comments
vrushalic commented
Some of the 2.0 job history files can be huge. HBase can't load such big files and the RawLoader step fails with java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.OutOfMemoryError: Java heap space.
Filing jira for a short term fix of considering not loading such huge history files