UWHustle/hustle

Multithreaded Predicate execution

srsuryadev opened this issue · 0 comments

Currently, in the select operator, we do multithreading between different batches (i.e a set of blocks). In this task, we will experiment and see if we are getting speed-up by doing much fine multithreaded execution.

  • Do multithreaded execution of the leaf nodes (i.e comparison operator execution) in the predicate tree.
  • Have this feature togglable so that it can enabled and disabled easily using macros.
  • Compare the SSB benchmark performance by enabling it and disabling it.
  • Add further robust unit tests to the Select operators

Ref:
Comparison operator call,

return Filter(block, node->predicate_);

Sample ref for multithreaded implementation,
ctx->spawnTask(CreateTaskChain(