spark-streaming
There are 1107 repositories under spark-streaming topic.
Angel-ML/angel
A Flexible and Powerful Parameter Server for large-scale machine learning
lw-lin/CoolplaySpark
酷玩 Spark: Spark 源代码解析、Spark 类库等
LuckyZXL2016/Movie_Recommend
基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统
dotnet/spark
.NET for Apache® Spark™ makes Apache Spark™ easily accessible to .NET developers.
jacksu/utils4s
scala、spark使用过程中，各种测试用例以及相关资料整理
edp963/wormhole
Wormhole is a SPaaS (Stream Processing as a Service) Platform
microsoft/Mobius
C# and F# language binding and extensions to Apache Spark
cdapio/cdap
An open source framework for building data analytic applications.
lw-lin/streaming-readings
Streaming System 相关的论文读物
Stratio/sparta
Real Time Analytics and Data Pipelines based on Spark Streaming
spirom/LearningSpark
Scala examples for learning to use Spark
databrickslabs/dbldatagen
Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines
harbby/sylph
Stream computing platform for bigdata
databrickslabs/dqx
Databricks framework to validate Data Quality of pySpark DataFrames
microsoft/data-accelerator
Data Accelerator for Apache Spark simplifies onboarding to Streaming of Big Data. It offers a rich, easy to use experience to help with creation, editing and management of Spark jobs on Azure HDInsights or Databricks while enabling the full power of the Spark engine.
paypal/gimel
Big Data Processing Framework - Unified Data API or SQL on Any Storage
Azure/azure-event-hubs-spark
Enabling Continuous Data Processing with Apache Spark and Azure Event Hubs
mkuthan/example-spark
Spark, Spark Streaming and Spark SQL unit testing strategies
Chabane/bigdata-playground
A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
bluishglc/bdp
A prototype project of big data platform, the source codes of the book Big Data Platform Architecture and Prototype
spirom/spark-streaming-with-kafka
Self-contained examples of Apache Spark streaming integrated with Apache Kafka.
hortonworks/streamline
StreamLine - Streaming Analytics
awantik/pyspark-learning
Updated repository
P7h/Spark-MLlib-Twitter-Sentiment-Analysis
:star2: :sparkles: Analyze and visualize Twitter Sentiment on a world map using Spark MLlib
qubole/kinesis-sql
Kinesis Connector for Structured Streaming
mkuthan/example-spark-kafka
Apache Spark and Apache Kafka integration example
LearningJournal/Spark-Streaming-In-Python
Apache Spark 3 - Structured Streaming Course Material
wangj1106/recommendMoteur
电影推荐系统、电影推荐引擎、使用Spark完成的电影推荐引擎
abulbasar/pyspark-examples
Code examples on Apache Spark using python
martandsingh/ApacheSpark
This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which we need in our real life experience as a data engineer. We will be using pyspark & sparksql for the development. At the end of the course we also cover few case studies.
snowch/movie-recommender-demo
This project walks through how you can create recommendations using Apache Spark machine learning. There are a number of jupyter notebooks that you can run on IBM Data Science Experience, and there a live demo of a movie recommendation web application you can interact with. The demo also uses IBM Message Hub (kafka) to push application events to topic where they are consumed by a spark streaming job running on IBM BigInsights (hadoop).
huangyueranbbc/Spark_ALS
基于spark-ml,spark-mllib,spark-streaming的推荐算法实现
chermenin/spark-states
Custom state store providers for Apache Spark
jmcmt87/spark_app_twitter
A data engineering project (Twitter monitor app)
huangyueranbbc/SparkDemo
spark全示例代码(java、scala) Spark most full instance code DEMO (java、scala)
yugokato/Spark-and-Kafka_IoT-Data-Processing-and-Analytics
Final Project for IoT: Big Data Processing and Analytics class. Analyzing U.S nationwide temperature from IoT sensors in real-time