TrivadisPF/kafka-backup

Data Retention on backup data

Closed this issue · 1 comments

Data retention on the topic should propagate to the backup data. If a segment is deleted from Kafka, then the corresponding data on the backup should be removed as well (after another configurable retention time).

Using the configuration properties of the connector it is possible to set the retention time (in days) about the backup data. Automatically when the connector start will create/update the retention time for the prefix (topic-name/...). In this case we will use the retention of S3 on AWS to remove the old record stored inside the backup