Strict Kafka permissions causing KMS to be in a crash loop
Closed this issue · 1 comments
dale-conroy commented
We are implementing KMS as part of NOW TV's commerce platform. We have our own instance of Kafka that is managed by our DevOps. They are enforcing strict permissions on consuming and producing to whitelisted topics. This means, if KMS is given an incorrect topic to produce to, the producer will throw an exception, causing KMS to crash - but more importantly, does not remove this garbage message from the scheduling queue, so as soon as KMS starts back up, it will try to schedule the message again, and fail.
It would be good if we could configure KMS to handle these exceptions instead of just crashing. In this instance, the message should be removed from the scheduling topic to prevent future issues.
dale-conroy commented
Discussed.