Playground for Kafka/Confluent Docker experimentations...
ℹ️ How to run
- 🔗 Kafka Connectors
- ☁️ Confluent Cloud
- 🔄 Confluent Replicator and Mirror Maker 2
- 🔐 Environments
- Confluent Commercial
- CP-Ansible Playground
- 👾 Other Playgrounds
- 📚 Useful Resources
Quick start examples from Confluent docs but in Docker version for ease of use.
| Connector | Product Category | Latest Version (*) | Type | Release Date | CP 6.1.1 CI latest results | CP 6.0.2 CI latest results | CP 5.5.4 CI latest results |
|---|---|---|---|---|---|---|---|
 ActiveMQ Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| ActiveMQ Source |
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Amazon CloudWatch Logs Source |
Analytics | 1.1.0 | Confluent Subscription | 2021-01-06 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
| Amazon CloudWatch Metrics Sink |
Analytics | 1.1.4 | Confluent Subscription | 2021-03-25 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
 Amazon DynamoDB Sink |
Database | 1.2.0 | Confluent Subscription | 2021-04-20 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Amazon Kinesis Source (also with 🌐 proxy) |
Message Queue | 1.3.5 | Confluent Subscription | 2021-04-13 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
 Amazon Redshift Sink |
Data Warehouse | 1.0.5 | Confluent Subscription | 2021-02-22 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
| Amazon Redshift Source (using JDBC) |
Data Warehouse | JDBC version | Confluent Community License | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested | |
 Amazon S3 Sink |
Datastore | 10.0.0 | Confluent Community License | 2021-03-03 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
| Amazon S3 Source |
Datastore | 1.4.5 | Confluent Subscription | 2021-04-08 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
 Amazon SQS Source |
Message Queue | 1.1.1 | Confluent Subscription | 2021-01-30 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
 AMPS Source |
Message Queue | 1.0.0-preview | Confluent Subscription | 2020-07-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Apache Kudu Source |
Database | 1.0.2 | Confluent Subscription | 2021-03-12 | 👍 2021-04-22 | 👍 2021-04-22 | ❌ 2021-04-23 🐞 #910 |
| Apache Kudu Sink |
Database | 1.0.2 | Confluent Subscription | 2021-03-12 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 AWS Lambda Sink |
SaaS Apps | 1.1.1 | Confluent Subscription | 2021-01-07 | 👍 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-23 |
 Azure Blob Storage Sink |
Datastore | 1.6.2 | Confluent Subscription | 2021-04-12 | 👍 2021-04-22 | 👍 2021-04-22 | ❌ 2021-04-23 🐞 #909 |
| Azure Blob Storage Source |
Datastore | 1.4.5 | Confluent Subscription | 2021-04-08 | ❌ 2021-04-23 🐞 #778 | ❌ 2021-04-23 🐞 #778 | 👍 2021-04-23 |
 Azure Cosmos DB Sink |
Datastore | 1.0.4-beta | MIT License | 2021-02-24 | 👍 2021-04-22 | ❌ 2021-04-23 🐞 #894 | ❌ 2021-04-23 🐞 #894 |
| Azure Cosmos DB Source |
Datastore | 1.0.4-beta | MIT License | 2021-02-24 | 👍 2021-04-22 | ❌ 2021-04-23 🐞 #846 | ❌ 2021-04-23 🐞 #846 |
 Azure Data Lake Storage Gen1 Sink |
Datastore | 1.6.2 | Confluent Subscription | 2021-04-12 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Azure Data Lake Storage Gen2 Sink |
Datastore | 1.6.2 | Confluent Subscription | 2021-04-12 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Azure Event Hubs Source |
Message Queue | 1.2.0 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Azure Functions Sink |
SaaS Apps | 1.0.9 | Confluent Subscription | 2021-02-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Azure Search Sink |
Analytics | 1.0.4 | Confluent Subscription | 2021-02-03 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Azure Service Bus Source |
Message Queue | 1.1.3 | Confluent Subscription | 2021-01-29 | 👍 2021-04-22 | 👍 2021-04-22 | ❌ 2021-04-23 🐞 #908 |
 Azure SQL Data Warehouse Sink |
Data Warehouse | 1.0.4 | Confluent Subscription | 2020-10-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Cassandra Sink |
Database | 2.0.0 | Confluent Subscription | 2020-12-04 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Couchbase Sink |
Database | 4.0.6 | Open Source (Couchbase, Inc.) | 2021-04-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Couchbase Source |
Database | 4.0.6 | Open Source (Couchbase, Inc.) | 2021-04-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Debezium CDC Microsoft SQL Server Source |
CDC | 1.5.0 | Open Source (Debezium Community) | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 | |
 Debezium CDC MySQL Source |
CDC | 1.5.0 | Open Source (Debezium Community) | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 | |
 Debezium CDC PostgreSQL Source |
CDC | 1.4.1 | Open Source (Debezium Community) | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 | |
 Debezium CDC MongoDB Source |
CDC | 1.5.0 | Open Source (Debezium Community) | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 | |
 Data Diode Sink |
Logs | 1.1.1 | Confluent Subscription | 2019-10-18 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Data Diode Source |
Logs | 1.1.1 | Confluent Subscription | 2019-10-18 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Datadog Metrics Sink |
Analytics | 1.1.4 | Confluent Subscription | 2021-03-25 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 ElasticSearch Sink |
Analytics | 11.0.3 | Confluent Community License | 2021-03-12 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 FTPS Sink |
Datastore | 1.0.3-preview | Confluent Subscription | 2020-10-01 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| FTPS Source |
Datastore | 1.0.3-preview | Confluent Subscription | 2020-10-01 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Gemfire Sink |
Database | 1.0.6 | Confluent Subscription | 2021-03-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Github Source |
SaaS Apps | 1.0.4 | Confluent Subscription | 2021-03-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Google BigQuery Sink |
Data Warehouse | 2.1.3 | Open Source (WePay) | 2021-04-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Google Cloud BigTable Sink |
Database | 1.0.7 | Confluent Subscription | 2021-03-05 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Google Cloud Functions Sink |
SaaS Apps | 1.1.3 | Confluent Subscription | 2021-02-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Google Cloud Pub/Sub Source (also with 🌐 proxy) |
Message Queue | 1.0.6 | Confluent Subscription | 2021-01-16 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Google Cloud Spanner Sink |
Database | 1.0.5 | Confluent Subscription | 2021-03-11 | ❌ 2021-04-23 🐞 #792 | ❌ 2021-04-23 🐞 #792 | ❌ 2021-04-23 🐞 #792 |
 Google Cloud Storage Sink |
Datastore | 5.5.6 | Confluent Subscription | 2021-04-20 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Google Cloud Storage Source |
Datastore | 1.4.5 | Confluent Subscription | 2021-04-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Google Firebase Realtime Database Sink |
Database | 1.2.0 | Confluent Subscription | 2020-12-01 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Google Firebase Realtime Database Source |
Database | 1.2.0 | Confluent Subscription | 2020-12-01 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 HBase Sink |
Database | 1.0.7 | Confluent Subscription | 2021-03-05 | ❌ 2021-04-23 🐞 #878 | ❌ 2021-04-23 🐞 #878 | ❌ 2021-04-23 🐞 #878 |
 HDFS 2 Source |
Datastore | 1.4.5 | Confluent Subscription | 2021-04-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| HDFS 3 Source |
Datastore | 1.4.5 | Confluent Subscription | 2021-04-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| HDFS 2 Sink |
Datastore | 10.0.2 | Confluent Community License | 2021-03-15 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| HDFS 3 Sink |
Datastore | 1.1.1 | Confluent Subscription | 2021-03-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 HTTP Sink |
SaaS Apps | 1.3.0 | Confluent Subscription | 2021-04-02 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 IBM MQ Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| IBM MQ Source |
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 InfluxDB Sink |
Database | 1.2.1 | Confluent Subscription | 2020-09-30 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| InfluxDB Source |
Database | 1.2.1 | Confluent Subscription | 2020-09-30 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JDBC CockroachDB Source |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-23 | 👍 2021-04-23 | 👍 2021-04-23 |
 JDBC Hive Sink |
Database | JDBC version | Confluent Community License | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested | |
| JDBC MySQL Sink (also with 🔑 SSL and mTLS) |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JDBC Oracle 11 Sink |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JDBC Oracle 12 Sink (also with 🔑 SSL and mTLS) |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC PostGreSQL Sink |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC Microsoft SQL Server Sink |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JDBC Vertica Sink |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC MySQL Source (also with 🔑 SSL and mTLS) |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC Oracle 11 Source |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC Oracle 12 Source (also with 🔑 SSL and mTLS) |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC PostGreSQL Source |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JDBC Microsoft SQL Server Source |
Database | 10.1.1 | Confluent Community License | 2021-04-13 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JIRA Source |
SaaS Apps | 1.0.4-preview | Confluent Subscription | 2021-03-22 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JMS ActiveMQ Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JMS Solace Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JMS TIBCO EMS Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| JMS TIBCO EMS Source |
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 JMS Oracle Weblogic Source |
Message Queue | 11.0.2 | Confluent Subscription | 2021-03-17 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Mapr Sink |
Datastore | 1.1.3 | Confluent Subscription | 2021-03-11 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
 Marketo Source |
SaaS Apps | 1.0.0-preview | Confluent Subscription | 2020-10-20 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Minio Sink |
Datastore | 10.0.0 | Confluent Community License | 2021-03-03 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| MongoDB Sink |
Database | 1.2.0 | Open Source (MongoDB) | 2020-07-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| MongoDB Source |
Database | 1.2.0 | Open Source (MongoDB) | 2020-07-08 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 MQTT Sink |
IoT | 1.4.0 | Confluent Subscription | 2020-10-29 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| MQTT Source |
IoT | 1.4.0 | Confluent Subscription | 2020-10-29 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Neo4j Sink |
Database | 1.0.9 | Open Source (Neo4j, Inc.) | 2020-09-02 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 OmniSci Sink |
Database | 1.0.2 | Confluent Subscription | 2019-08-20 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Oracle CDC (also with 🔑 SSL and mTLS) |
Database | 1.0.5 | Confluent Subscription | 2021-03-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 PagerDuty Sink |
SaaS Apps | 1.0.2 | Confluent Subscription | 2020-11-18 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Prometheus Sink |
Analytics | 1.1.4-preview | Confluent Subscription | 2021-03-25 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 RabbitMQ Sink |
Message Queue | 1.5.0 | Confluent Subscription | 2021-03-04 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| RabbitMQ Source |
Message Queue | 1.5.0 | Confluent Subscription | 2021-03-04 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Redis Sink |
Database | 0.0.2.12 | Open Source (Jeremy Custenborder) | 2021-03-24 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 SalesForce Bulk API Sink |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SalesForce Bulk API Source |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SalesForce CDC Source |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SalesForce Platform Events Sink |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SalesForce Platform Events Source |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SalesForce PushTopics Source |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SalesForce SObject Sink |
SaaS Apps | 1.8.2 | Confluent Subscription | 2021-04-14 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 ServiceNow Sink |
SaaS Apps | 2.1.1 | Confluent Subscription | 2021-04-12 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
| ServiceNow Source (also with 🌐 proxy) |
SaaS Apps | 2.1.1 | Confluent Subscription | 2021-04-12 | 🤷♂️ not tested | 🤷♂️ not tested | 🤷♂️ not tested |
 SFTP Sink |
Datastore | 2.3.0 | Confluent Subscription | 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| SFTP Source |
Datastore | 2.3.0 | Confluent Subscription | 2021-04-21 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 SNMP Trap Source |
IoT | 1.1.2 | Confluent Subscription | 2020-04-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Snowflake Sink |
Data Warehouse | 1.5.2 | Open Source (Snowflake, Inc.) | 2021-02-01 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Solace Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Solace Source |
Message Queue | 1.2.0 | Confluent Subscription | 2020-08-26 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Splunk Sink |
Analytics | 2.0.2 | Open Source (Splunk) | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 | |
| Splunk Source |
Analytics | 1.0.3 | Confluent Subscription | 2020-11-18 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Spool Dir Source |
Datastore | 2.0.61 | Open Source (Jeremy Custenborder) | 2021-03-26 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Syslog Source |
Logs | 1.3.2 | Confluent Subscription | 2020-11-03 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| TIBCO EMS Sink |
Message Queue | 1.3.2 | Confluent Subscription | 2021-02-19 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| TIBCO EMS Source |
Message Queue | 1.2.0 | Confluent Subscription | 2020-08-26 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
| Vertica Sink |
Database | 1.2.5 | Confluent Subscription | 2021-02-18 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
 Zendesk Source |
SaaS Apps | 1.0.6 | Confluent Subscription | 2021-03-09 | 👍 2021-04-22 | 👍 2021-04-22 | 👍 2021-04-23 |
* You can change default connector version by setting CONNECTOR_TAG environment variable before starting a test, get more details here
- How to connect your components to Confluent Cloud
- How to monitor your Confluent Cloud cluster
- How to restrict access
- etc...
AWS Kinesis source
ServiceNow source- ServiceNow sink
MongoDB source
Firebase
- Using cp-ansible with Confluent Cloud
- Using cp-helm-charts with Confluent Cloud
- Using confluent operator with Confluent Cloud
- Demo using dabz/ccloudexporter in order to pull Metrics API data from Confluent Cloud cluster and export it to Prometheus (Grafana dashboard is also available)
.NET client (producer/consumer)
Go client (producer/consumer)kafka-admin Managing topics and ACLs using matt-mangia/kafka-admin
Confluent Replicator OnPrem to cloud and Cloud to Cloud examples
Multi-Cluster Schema Registry with hybrid configuration (onprem/confluent cloud)
- Confluent REST Proxy Security Plugin with Principal Propagation
- Confluent Schema Registry Security Plugin
- Migrate Schemas to Confluent Cloud using Confluent Replicator
- Confluent Cloud Networking using HAProxy
Using Multi-Data-Center setup with US 🇺🇸 and EUROPE 🇪🇺 clusters.
Using Confluent Replicator as connector
- Using PLAINTEXT
- Using SASL_PLAIN
- Using Kerberos
- 👾 Using Confluent Replicator as executable
- Using PLAINTEXT
- Using SASL_PLAIN
- Using Kerberos
Using Mirror Maker 2
- Using PLAINTEXT
Single cluster:
- PLAINTEXT: no security
- SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
- SASL/SCRAM no SSL encryption, SASL/SCRAM-SHA-256 authentication
- SASL_SSL: SSL encryption, SASL/PLAIN authentication
- 2WAY_SSL: SSL encryption, SSL authentication
- Kerberos: no SSL encryption, Kerberos GSSAPI authentication
- SSL_Kerberos SSL encryption, Kerberos GSSAPI authentication
- LDAP Authorizer with SASL/PLAIN no SSL encryption, SASL/PLAIN authentication, LDAP Authorizer for ACL authorization
- RBAC with SASL/PLAIN RBAC with no SSL encryption, SASL/PLAIN authentication
Multi-Data-Center setup:
- PLAINTEXT: no security
- SASL_PLAIN: no SSL encryption, SASL/PLAIN authentication
- Kerberos: no SSL encryption, Kerberos GSSAPI authentication
- Control Center
- Tiered Storage
- Tiered storage with AWS S3
- Tiered storage with Minio (unsupported)
- Confluent Rebalancer
- JMS Client
- RBAC with SASL/PLAIN RBAC with no SSL encryption, SASL/PLAIN authentication
- Audit Logs
- Confluent REST Proxy Security Plugin with SASL_SSL and 2WAY_SSL Principal Propagation
Easily play with Confluent Platform Ansible playbooks by using Ubuntu based Docker images generated daily from this cp-ansible-playground repository
There is also a Confluent Cloud version available here
- Confluent Replicator [also with SASL_SSL and 2WAY_SSL]
- Testing Separate principals (
connector.client.config.override.policy) for Source connector (SFTP source) - Testing Separate principals (
connector.client.config.override.policy) for Source connector (SFTP sink) - How to write logs to files when using docker-compose
- Publish logs to kafka with Elastic Filebeat
Monitor Confluent Platform with Datadog
- A Kafka Story 📖: A step by step guide to use Kafka ecosystem (Kafka Connect, KSQL, Java Consumers/Producers, etc..) with Docker
- Kafka Boom Boom 💥: An attempt to break kafka
- Kafka Security playbook 🔒: demonstrates various security configurations with Docker
- MDC and single views 🌍: Multi-Data-Center setup using Confluent Replicator
- Kafka Platform Prometheus 📊: Simple demo of how to monitor Kafka Platform using Prometheus and Grafana.