Canner/wren-engine

[EPIC] Redesign the modeling module with DataFusion and Rust

goldmedal opened this issue · 1 comments

goldmedal commented

Description

Our goal is redesigning the modeling part of Wren Engine using DataFusion. Make it be more portable and composable. With DataFusion at the helm, we expect to deliver full SQL support an query planning.

Todo Lists

  • Model
  • Column
    • Expression #570
    • Calculated Field
  • Relationship
    • MDL Lineage #588
    • Relationship Column #595
    • Used by Calculated Field
      • TO_ONE #595 #613
      • TO_MANY
      • Use the calculated field in another related model #676
  • View
    • Query View #645
    • Cycling View Check #645
  • Macro (https://docs.rs/minijinja/latest/minijinja/)
  • Python API (PyO3)
  • CI workflow (We can follow how DataFusion do it)
    • Cargo Build Test
    • Unit test
    • Cargo fmt check
    • Cargo clippy check
    • e2e test #604
  • type enhancement #590
goldmedal commented

All tickets have been finished. The beta version will be released soon.