/spark-cloudwg-2015

Materials for BRC/D-Lab Cloud Working group session on Spark on AWS and Savio

Primary LanguagePython

spark-cloudwg-2015

Materials for BRC/D-Lab Cloud Working group session on Spark on AWS and Savio

The file pres.pdf has an overview. The files example-aws.sh and example-savio.sh show how to get Spark up and running on AWS and Savio. The files example-analysis.py and example-sql.py show how to use the Python interface for Spark (PySpark) to run analyses, including using Spark SQL (example-sql.py).