splunk-otel-kafka

How to track kafka components with Splunk Observability Cloud and Opentelemetry

Prerequisites

Set these following variables

export SPLUNK_ACCESS_TOKEN=YOUR_SPLUNK_ACCESS_TOKEN

export SPLUNK_REALM=YOUR_SPLUNK_REALM

Up and build containers

docker-compose up -d --build --remove-orphans

After some seconds, your Service Map in Splunk Observability Cloud will looks like this:

You can use the kafkacat container to perform tests, create new topics and troubleshooting in an easy way.

Open a terminal and execute the following commands:

docker exec -ti kafka-cat bash
kafkacat -P -b kafka:9092 -t test
message1
message2

In a second terminal execute the following commands:

docker exec -ti kafka-cat bash
kafkacat -b kafka:9092 -t test

At the second terminal you should see the messages being consumed

docker-compose down --remove-orphans