Aiven-Open/gcs-connector-for-apache-kafka

[Feature request] specific naming pattern for created files

Closed this issue · 5 comments

Hi guys, thanks for your work!
I have two questions:

  1. I am currently using Kafka GCS sink connector, and I am wondering can I somehow configure my specific naming pattern for created files (for example to take some value from the event).
  2. Also, I am interested can I configure a write process of only one record per file in Kafka GCS sink connector.

@IvanIschenko for 2, I created a separate issue (#9) and start working on it.

@IvanIschenko about 1, could you please give an example of the naming pattern you would like to have?

@ivanyu Currently, we are using <prefix><topic>-<partition>-<start-offset>[.gz] pattern for files.
Can we use key values from the message in Kafka topic (so I can paste in theory any value there)?

@IvanIschenko FYI: #19 (mainly, README.md)

I will close this task because of #19 task.