bobluppes/csv-to-parquet

Example Apache Spark 2.0.0-2.4.5 + Scala application.

Spark csv to parquet converter

Uses Spark 3.0.0 to convert csv files to uncompressed parquet files

Running

Run the following:

sbt compile
sbt run