services | platforms | author |
---|---|---|
hdinsight |
scala |
blackmist |
Use Spark Structured Streaming with Apache Spark and Kafka on HDInsight
This example contains a Jupyter notebook that demonstrates how to use Spark structured streaming with Kafka on HDInsight
Note: This example requires Spark 2.2.0, which is available in HDInsight 3.6. The Spark and Kafka clusters must also be in the same Azure Virtual Network. To create a resource group containing all the services needed for this example, use the resource manager template in the Use Spark Structured Streaming with Kafka document.
Contributing
This project has adopted the Microsoft Open Source Code of Conduct. For more information see the Code of Conduct FAQ or contact opencode@microsoft.com with any additional questions or comments.