DataOps with Nessie, Iceberg, Spark and Great Expectations

Repo of the demo performed at Subsurface 2023.

Getting started

  1. build the docker image: docker build . -t nessie-demo
  2. on one background shell run ./start-nessie.sh
  3. on another shell run ./start-shell
  4. Run the commands that are in the commands text file
  5. Have fun 🐉