Use morsel driven scheduler from datafusion
Closed this issue · 0 comments
roeap commented
https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/src/scheduler/mod.rs
this would be a first step towards more formally leveraging the resource management capabilities in darafusion. alos this will run in the rayon threadpool, which is more suited to CPU bound workloads ...