roeap/flight-fusion

Use morsel driven scheduler from datafusion

Closed this issue · 0 comments

roeap commented

https://github.com/apache/arrow-datafusion/blob/master/datafusion/core/src/scheduler/mod.rs

this would be a first step towards more formally leveraging the resource management capabilities in darafusion. alos this will run in the rayon threadpool, which is more suited to CPU bound workloads ...