/structured-streaming

Apache Spark Structured Streaming project, presented at QConSP19 in São Paulo Brazil Edition.

Primary LanguagePython

QConSP19

Structured-streaming

Apache Spark Structured Streaming project, presented at QConSP19 in São Paulo Brazil Edition.

Under source dir we have:

  • file:

    • how to read a directory as a Stream of data

  • kafka:

    • an example of reading data and processing from Kafka Stream