/data-in-motion

Random stuff to share related to Data in Motion

Primary LanguagePython

Data In Motion

This repository contains examples, code snippets and helper scripts related to Data in Motion technologies. These are usually related to the following technologies, but not necessarily limited to this list:

  • Kafka & friends

  • NiFi & friends

  • Flink

  • Spark Streaming

Kafka

Example Purpose

Cross-Kafka Kerberos authentication

Small Spark Structured Streaming job showing how to use distinct Kerberos credentials to connect to two distinct Kafka clusters

NiFi Registry

Example Purpose

Flow import/export

Script to export and import flows from/to NiFi Registry using the service’s REST API