slackhq/astra

Pre-processor should write data to different kafka cluster

Closed this issue · 0 comments

mansu commented

Update pre-processor to write data to a different kafka cluster than the kafka cluster the pre-processor is consuming data from.

Currently, we use Kafka streams for this transformation which is limited to reading and writing messages to the same kafka cluster.