Pinned Repositories
30min_guides
覃健祥的学习笔记，各种几十分钟入门的文档
BasicAuthFilter
hadoop
Mirror of Apache Hadoop
java_spark_receiver_kafka
JavaWordCount
spark_hbase
spark use hbase with rdd
spark_kryo_serializer_java
spark use kryo serializer with java
SparkStreaming_Store_KafkaTopicOffset_To_HBase
Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So if you want the equivalent of exactly-once semantics, you must either store offsets after an idempotent output, or store offsets in an atomic transaction alongside output.There is Spark Streaming how to store Kafka topic offset with HBase.
wangliangbd's Repositories
wangliangbd/SparkStreaming_Store_KafkaTopicOffset_To_HBase
Kafka delivery semantics in the case of failure depend on how and when offsets are stored. Spark output operations are at-least-once. So if you want the equivalent of exactly-once semantics, you must either store offsets after an idempotent output, or store offsets in an atomic transaction alongside output.There is Spark Streaming how to store Kafka topic offset with HBase.
wangliangbd/30min_guides
覃健祥的学习笔记，各种几十分钟入门的文档
wangliangbd/BasicAuthFilter
wangliangbd/hadoop
Mirror of Apache Hadoop
wangliangbd/java_spark_receiver_kafka
wangliangbd/JavaWordCount
wangliangbd/spark_hbase
spark use hbase with rdd
wangliangbd/spark_kryo_serializer_java
spark use kryo serializer with java