dani8art/innosoftdays-spring-cloud-dataflow

Project for a demo in my talk at InnoSoft Days

Introduction to Spring Cloud Dataflow: Steaming apps and Bitnami Charts

You can see the slides here

The recording of the talk here, start at 1h 15min

Requirements

• Kubernetes cluster using: Minikube, Docker Desktop or any cloud provider.
• Helm command line

Installing charts

Install Bitnami charts repository

$ helm repo add bitnami https://charts.bitnami.com/bitnami

Install monitoring tools

$ ./scripts/deploy-monitoring.sh

Install dataflow

$ ./scripts/deploy-dataflow.sh

Install applications database

$ ./scripts/deploy-mongodb.sh

Stream DSLs

composed-data=trigger --payload="{ \"data\": { \"temperature\": 12 } }" --cron="*/1 * * * * *" | break-down: transform --expression=#jsonPath(payload,'$.data') > :sources
main=:sources > log
simple-data=trigger --payload="{ \"temperature\": 10 }" --cron="*/5 * * * * *" > :sources

Get mongodb password

$ k get secrets mongodb -o=jsonpath='{.data.mongodb-password}' | base64 --decode

composed-data=trigger --payload="{ \"data\": { \"temperature\": 12 } }" --cron="*/1 * * * * *" | break-down: transform --expression=#jsonPath(payload,'$.data') > :sources
main=:sources > mongodb --authentication-database=innosoft-demo --username=innosoft-demo-user --database=innosoft-demo --password=rDWuDtGG7b --port=27017 --host=mongodb.default.svc.cluster.local --collection=measures
simple-data=trigger --payload="{ \"temperature\": 10 }" --cron="*/5 * * * * *" > :sources

composed-data=trigger --payload="{ \"data\": { \"temperature\": 12 } }" --cron="*/1 * * * * *" | break-down: transform --expression=#jsonPath(payload,'$.data') > :sources
main=:sources > mongodb --authentication-database=innosoft-demo --username=innosoft-demo-user --database=innosoft-demo --password=rDWuDtGG7b --port=27017 --host=mongodb.default.svc.cluster.local --collection=measures
simple-data=trigger --payload="{ \"temperature\": 10 }" --cron="*/5 * * * * *" > :sources
expose-data=mongodb --authentication-database=innosoft-demo --username=innosoft-demo-user --database=innosoft-demo --password=rDWuDtGG7b --port=27017 --host=mongodb.default.svc.cluster.local --collection=measures | websocket

source-raw=trigger --payload="{ \"data\": { \"temperature\": 12 } }" --cron="*/1 * * * * *" | data-to-temperature: transform --expression=#jsonPath(payload,'$.data') > :sources
main=:sources > mongodb --authentication-database=innosoft-demo --username=innosoft-demo-user --database=innosoft-demo --password=rDWuDtGG7b --port=27017 --host=mongodb.default.svc.cluster.local --collection=measures
expose=:sources > websocket
source-json=trigger --payload="{ \"temperature\": 10 }" --cron="*/5 * * * * *" > :sources

Forward port for websocket

$ k port-forward pod/expose-data-websocket-v1-6b6b56d45f-skkfr 8888:9292