Spark toolbox & training exercices

  • Exercice 1 : Write batch DF to kafka topic
  • Exercice 2 : Read batch DF from kafka topic
  • Exercice 3 : Structured Streaming - Read json formated data from kafka & write df to kafka
  • Exercice 4 : DStream - RDD from textfile
  • Exercice 5 : DStream - RDD from kafka json
  • Exercice 6 : Structured Streaming - Read logs from kafka - write processed logs to kafka