/spark-dsl-generator

Prototype: Java DSL generator for Spark columns supporting Parquet & SQL files using Hive/Iceberg dialect

Primary LanguageJava

Spark DSL Generator

Java DSL generator which supports Parquet and SQL files with Hive/Iceberg dialect

TODO

  • Parquet schema parser
  • Iceberg schema parser
  • Hive schema parser
  • DSL generator
  • Maven plugin