sirius-db/sirius

Support for input data and intermediate results larger than GPU memory

Opened this issue · 0 comments

bwyogatama commented

Sirius currently fails when input data/intermediate results are larger than the GPU memory. We are actively working to resolve this issue by adding the following features:

  1. Partitioning the input data and streaming it from host memory/disk/SSD
  2. Spilling intermediate results to host memory/disk/SSD