/workshop-intro-streaming-and-cdc

We will visit the basics of change data capture (CDC) and why it's become so popular recently - with CDC, developers create smarter applications when real-time data is connected to the whole data ecosystem. During the workshop we will highlight use cases that make it your go-to solution when modernizing applications, getting more value out of your data (real-time), and joining new machine learning techniques with old applications. We will introduce you to Apache Pulsar, show you how to enable the CDC feature in Datastax Astra, how to set up Astra Streaming, and (of course) how to get it all working together!

Primary LanguageJava

🔥🔥 Introduction to Event Stream Processing and Change Data Capture (CDC) 🔥🔥

Welcome to the 'Introduction to Event Stream Processing and Change Data Capture (CDC)' workshop. In this two-hour workshop, the Developer Advocate team of DataStax shows the most important fundamentals and basics of Apache Pulsar and the Change Data Capture (CDC) pattern.

It doesn't matter if you join our workshop live or you prefer to do at your own pace, we have you covered. In this repository, you'll find everything you need for this workshop.

Getting Started

The workshop lab has no pre-req's, it's all within GitPod. The homework does require a Astra account with special access to GCP cloud zones. Refer to the workshop badge area below for more detail.

Workshop assets

Workshop Lab: Interacting with the Pulsar Broker

  1. Get familar with the Pulsar environment
  2. Pub/Sub
  3. Augmenting message text
  4. Filtering messages to other topics
  5. Adding a source connector

First, open the lab environment:

Open Gitpod

Once the environment has initialized, start the lab

Earning the workshop badge

To earn the badge for this workshop, you'll need to answer the homework questions. All the instructions for homework are in the form. Once submitted, we will evaluate your answers and you will receive an email with the badge certificate.