Pinned Repositories
camus
LinkedIn's previous generation Kafka to HDFS pipeline.
cdh-deploy-robot
DataX
flume-ftp-source
FTP network server is source of events for Apache-flume
incubator-gobblin
Gobblin is a distributed big data integration framework (ingestion, replication, compliance, retention) for batch and streaming systems. Gobblin features integrations with Apache Hadoop, Apache Kafka, Salesforce, S3, MySQL, Google etc.
KafkaGust
KafkaGust is a flexible and useful tool to quickly test high data volumes with Apache Kafka. Apache Kafka that is used in the world of Big Data (e.g : with Storm, Cassandra, Hadoop, etc.), is a fast and scalable publish-subscribe messaging that can handle durably hundreds of megabytes of reads and writes per second from thousands of clients.
RuleEngine
RuleEngineSpark
structured-streaming-avro-demo
Spark 2.2. Structured Streaming Kafka Avro Demo
structured-streaming-Kafka2HBase
Spark structured-streaming 消费kafka数据写入hbase
lyqhf153's Repositories
lyqhf153/incubator-gobblin
Gobblin is a distributed big data integration framework (ingestion, replication, compliance, retention) for batch and streaming systems. Gobblin features integrations with Apache Hadoop, Apache Kafka, Salesforce, S3, MySQL, Google etc.
lyqhf153/camus
LinkedIn's previous generation Kafka to HDFS pipeline.
lyqhf153/cdh-deploy-robot
lyqhf153/DataX
lyqhf153/flume-ftp-source
FTP network server is source of events for Apache-flume
lyqhf153/KafkaGust
KafkaGust is a flexible and useful tool to quickly test high data volumes with Apache Kafka. Apache Kafka that is used in the world of Big Data (e.g : with Storm, Cassandra, Hadoop, etc.), is a fast and scalable publish-subscribe messaging that can handle durably hundreds of megabytes of reads and writes per second from thousands of clients.
lyqhf153/RuleEngine
lyqhf153/RuleEngineSpark
lyqhf153/structured-streaming-avro-demo
Spark 2.2. Structured Streaming Kafka Avro Demo
lyqhf153/structured-streaming-Kafka2HBase
Spark structured-streaming 消费kafka数据写入hbase
lyqhf153/WhereHows
Data Discovery and Lineage for Big Data Ecosystem