fluent/fluent-plugin-kafka

Ruby-kafka/rdkafka connectors feature sets

hafkaM opened this issue · 2 comments

Hi.
In our company we use fluentd / bit for many projects.
Almost all transactions go via the kafka bus. So the kafka connector is very important for us.
Therefore, I would like to ask if you are considering these features for the connector?
Without these features, some use cases cannot be solved.
I mention the rdkafka connector because some use cases concern high performance - hundreds of thousands of EPS.

  • Possibility of consumption using group_id from a specific partition (now only without consumer id and after restart I lose offset)
  • Possibility of production directly into a specific partition (number). Now it can only be based on the kafka key, but the partition number is determined by the connector.
    Thanks
    M.

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

This issue was automatically closed because of stale in 30 days