Why is there a per-broker service for external (outside-cluster) access?
Opened this issue · 1 comments
prithviramesh commented
Our use case involves creating an Ingress that routes external access to our n-broker Kafka cluster. Currently, (without changing the Ingress to a "fan-out" Ingress) we can only map the Ingress to one of the external services which maps to one specific broker pod. What we actually want is our Ingress to load balance the producer to write to a topic that is partitioned on each of the n brokers.
solsson commented
It's by design, Kafka design. Clients are very much aware of broker topology. See for example #13 (comment).