/spark-playground

Quick Vagrantbox for experimenting with Spark 2.0

Primary LanguageHTML

Spark Playground

This vagrant box will install a single-instance Apache Spark 2.0.0, on Ubuntu 14.04, with JDK 8.

To start the vagrant box, simply install Vagrant and VirtualBox, then run this command:

vagrant up

This will set up a virtual machine with the following configurations:

  • Ubuntu 14.04
  • Apache Spark 2.0.0
  • JDK 8
  • All spark ports are mapped to local ports on host machine

The Spark is installed under path /spark

Start Spark

  • Login to the virtual machine:
vagrant ssh
  • Start Spark cluster
/spark/sbin/start-all.sh

-- You may need to enter the user password for "vagrant", which is default to "vagrant".

nfsen-bin.tar.gz - Binary folder installed into this vagrant VM , serving netflow nfsen live simulated traffic graphs - MUST to exploded into /var/nfsen folder in any VM

rrdtool-1.4.3.tar.gz - rrd tool for perl