Fedomn/spark-knowledge

my personal spark knowledge collection and playground

spark-knowledge

personal spark playground

Notes

• Spark:The Definitive Guide & Learning Spark 2.md

documentation

• The Internals of Spark SQL
• The Internals of Apache Spark
• pyspark入门工具书

playground

use Spark-The-Definitive-Guide's data as Datasets on this playground.

sdk requirements (global)

• java: 11.0.2-open
• Python 3.8.10 and add python interpreter in modules
• pyspark==3.3.2