banzaicloud/koperator

Koperator does not remove disk if it is removed from KafkaCluster CR

ilievladiulian opened this issue · 2 comments

ilievladiulian commented

Describe the bug
Removing a disk from the KafkaCluster CR does not remove the PVC from the cluster and does not update the kafka broker log.dirs.

Steps to reproduce the issue:

  1. Create a simple KafkaCluster with 2 disks per broker.
  2. Remove a disk from the brokers.

Expected behavior
The expected behavior would be that the KafkaCluster updates the log.dirs field in the broker configmaps so that the removed disk is no longer used and also removes the PVC.

Additional context
This seems to be related to PR-820 which does not allow the user to delete broker storage.

This feature is useful when the user wants to lower the number of disks used by:

  1. moving the data from specific disks without data loss using the remove disks endpoint in Cruise Control (PR-1908)
  2. removing disk from KafkaCluster CR
bartam1 commented

Dear @ilievladiulian !
Thank you for the feedback.
Kafka doesn't support broker log dir (storage) removal out of the box.
When this PR is merged and there is a new release for CC that contains it. This feature can be implemented.
Please inform us when the CC release is out thus we as maintainers or contributors can implement this feature.

pregnor commented

FYI I subscribed to the PR to see updates on it so manual notification might not be required. (cc: @bartam1 )

  • 👍1