zinggAI/zingg

Count of records happening in PipeUtil without debug setting check causing performance issue

Closed this issue · 1 comments

sonalgoyal commented

We should check isDebugEnabled in PipeUtil readInternal

for (Pipe p : pipes) { if (input == null) { input = readInternal(p, addSource); LOG.debug("input size is " + input.count()); } else { if(!addExtraCol) { input = input.union(readInternal(p, addSource)); } else { input = input.unionByName(readInternal(p, addSource),true); } } }