chauhankaranraj/aicoe-osc-demo

Explore OS-Climate demo concepts from Red Hat AICoE

Using Open Data Hub toolkit and Operate First infrastructure for OS-Climate

This repository is the central location for the demos the Open Services ( previously AICoE) team is developing within the OS-Climate project.

The following demos provide examples of how to use the tools available with Open Data Hub toolkit on an Operate First cluster to perform ETL, create inference pipelines, create interactive dashboards and visualizations of our data.

Demo 1 - ETL & Dashboarding

• Ingest raw data from S3 as tables on Trino
• Run SQL queries from a Jupyter Notebook environment
• Demo 1 Elyra Pipeline
• Results visualized on a Superset Dashboard
• Video on creating Elyra Pipelines and Superset Dashboard

Demo 2 - Automated Inference Pipeline and Dashboarding

• Steps to Create a JupyterHub image from the repository
• Automated inference pipeline
• Results visualized on a Superset Dashboard
• Video on creating JupyterHub image and inference pipeline