hazelcast-jet-contrib

This repository includes various community supported and incubating modules for Hazelcast Jet.

As a general guideline, the following types of modules are encouraged in this repository:

Various connectors, including both sources and sinks
Context factories. that potentially integrate with other systems.
Custom aggregations. These should be generic enough that they should be reusable in other pipelines.

Building from source

To build the project, use the following command

./gradlew build

List of modules

InfluxDb Connector

A Hazelcast Jet Connector for InfluxDb which enables Hazelcast Jet pipelines to read/write data points from/to InfluxDb.

Probabilistic Aggregations

A collection of probabilistic aggregations such as HyperLogLog.

Elasticsearch Connector

A Hazelcast Jet connector for Elasticsearch for querying/indexing objects from/to Elasticsearch.

Redis Connectors

Hazelcast Jet connectors for various Redis data structures.

MongoDB Connector

A Hazelcast Jet connector for MongoDB for querying/inserting objects from/to MongoDB.

Kafka Connect Connector

A generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

Debezium Connector

A Hazelcast Jet connector for Debezium which enables Hazelcast Jet pipelines to consume CDC events from various databases.

Twitter Connector

A Hazelcast Jet connector for consuming data from Twitter stream sources in Jet pipelines.

Snapshot Releases

To access snapshot builds add the following dependency and repository declarations to dependencies and repositories sections in your pom.xml respectively.

<dependency>
  <groupId>com.hazelcast.jet.contrib</groupId>
  <artifactId>${module.name}</artifactId>
  <version>${module.version}</version>
</dependency>

<repository>
    <id>sonatype-snapshots</id>
    <name>Sonatype Snapshot Repository</name>
    <url>https://oss.sonatype.org/content/repositories/snapshots</url>
    <releases>
        <enabled>false</enabled>
    </releases>
    <snapshots>
        <enabled>true</enabled>
    </snapshots>
</repository>

Contributing

We encourage pull requests and process them promptly.

To contribute:

see Contribution Guideline
see Developing with Git for our Git process
see README Template
complete the Hazelcast Contributor Agreement

Submit your contribution as a pull request on GitHub.

License