kafka-connect-hdfs is a Kafka Connector for copying data between Kafka and Hadoop HDFS.
Documentation for this connector can be found here.
A new HourlyPartitioner which can partition specific field using TimebasedPartitioner.
To build a development version you'll need a recent version of Kafka. You can build kafka-connect-hdfs with Maven using the standard lifecycle phases.
Refer frequently asked questions on Kafka Connect HDFS here - https://github.com/confluentinc/kafka-connect-hdfs/wiki/FAQ
- Source Code: https://github.com/confluentinc/kafka-connect-hdfs
- Issue Tracker: https://github.com/confluentinc/kafka-connect-hdfs/issues
The project is licensed under the Apache 2 license.