Apache Spark Docker cluster
Docker Hub for this image
Based on "A minimal Ubuntu base image modified for Docker-friendliness"
Dockerfile
links
Supported tags and respective
How to use this image
start a single apache spark instance
$ docker run --name some-spark -d kduda/spark
This image exposes 8080 - 9090, 7077, 6066, 4040
ports.
docker-compose up -d
start a spark cluster with spark/docker-compose.yml
- Spark Master and 4 workersspark-zeppelin/docker-compose.yml
- Zeppelin based on this image with Spark Master and 4 workers