Farfetch/kafkaflow

[Bug Report]: CreateTopicIfNotExists not working with security information

Ktosi33 opened this issue · 0 comments

Ktosi33 commented

Prerequisites

  • I have searched issues to ensure it has not already been reported

Description

Authentication error occurs while using CreateTopicIfNotExists with security information. The issue probably is in the ClusterManager class in the KafkaFlow.Clusters namespace where you create lazyAdminClientBuilder without passing security information in it, there's only BootstrapServers in AdminClientConfig. Without CreateTopicIfNotExists everything is fine while using security information.

Steps to reproduce

  1. Add WithSercurityInformation section to configuration
  2. Add CreateTopicIfNotExists to configuration
  3. use CreateBus/StartAsync - there probably is CreateTopicIfNotExists invoked

Expected behavior

Created topic if not existed

Actual behavior

Client logs:
...|FAIL|rdkafka#producer-1| .../bootstrap: Disconnected: verify that security.protocol is correctly configured, broker might require SASL authentication

Server logs:
[INFO [SocketServer ...] Failed authentication with /...(Unexpected Kafka request of type METADATA during SASL handshake.) (org.apache.kafka.common.network.Selector)

KafkaFlow version

2.2.16