Qbeast-io/qbeast-spark

Qbeast Spark Refactor: DataWriter abstraction.

Closed this issue · 1 comments

This issue is a subissue of #398

The PR #397 contains a full split within Delta, Spark and Core packages. Since it is a very big change, we decided to split into smaller groups of commits.

The first part should contain the abstraction of the RollupDataWriter interface, which now was called from the writing and the optimization process separately, depending on the FileAction, and poorly computing the domain.

Merged in #402 (not sure why it was not closed from there 😢 )