TU-Berlin-DIMA/scotty-window-processor

LazyEvaluation of the "Lift" function.

tuterbatuhan opened this issue · 3 comments

Hey,
"Lift" function is lazily evaluated by calling the getAggValues() function, as it can be seen here:

stream
.keyBy(0)
.process(windowOperator)
.map(x -> x.getAggValues().get(0).f1)
.print();

You may consider triggering the "Lift" function when a window ends, instead of adding another operator for lazy evaluation.

Hi @tuterbatuhan,

we will consider this for future versions of Scotty.

Best,
Philipp

Hi all, I wonder why this getAggValues() is lazily evaluated? Due to some performance concern?

Hi @jiayuasu,
The lazy evaluation, in this case, is related to the quantile computation. We do not expect a great performance benefit from changing it. If you have further questions, please feel free to contact us!

Best,
Juliane