/vagrant-spark-playground

Apache Spark cluster simulation using Vagrant

Apache License 2.0Apache-2.0

Usage

  • Clone the Vagrantfile on this repo.
  • Modify the N_SLAVE variable to set the number of slave nodes available.
  • Fire up the cluster using vagrant up.
  • Head into 10.0.0.10:8080 from your browser then look under Workers section to verify whether your slave nodes connected to the master node or not (number of available workers should equals with N_SLAVE value).