Material for the Data Mesh presentation at GoDataFest 2021 and the Codebreakfast handson session in March 2022
Instruqt is used to publish this material as a track with different challenges. The docker containers and notebooks can also be run locally with docker-compose
Both Azure Blob storage and GCS need a SSL connection enabled. Several certificates, keys and java truststores are needed for the diversity of libraries and programming languages used.
See SSL_README.md how to (re)generate those certificates
docker-compose up --build
Go to Jupyter Lab to see the notebooks.
The prepared datasets are described in data/DATA_PREP.md
cd packer-compose-vm
make PROJECT=instruqt-godatadriven IMAGE_NAME=instruqt-datamesh-multicloud-vm force-build
instruqt track validate && instruqt track push