/spark_streaming

spark streaming quick start

Primary LanguageScalaMIT LicenseMIT

spark_streaming

spark streaming quick start

目录

1.Spark streaming 处理HDFS/本地文件系统的文件数据

2.Spark streaming 整合flume实战 方式1 :pull

3.Spark streaming 整合flume实战 方式1 :push

4.计算到目前为止累加出现的单词个数并写入db

5.Spark streaming 整合kafka 实战:receiver-based

6.Spark streaming 处理socket数据

7.Spark streaming 整合spark sql 完成词频统计

8.计算到目前为止累加出现的单词个数并写入db

9.黑名单过滤实战

10.scala demo

待完成

1.Spark streaming 整合kafka 实战:Direct approach