Most of my focus is now on building Hadoop clusters in Docker. See https://github.com/timveil/docker-hadoop. This repository is no longer maintained.

HDP Vagrant Base

Overview

This is a Vagrant box that can serve as a sensible base to install the Hortonworks Data Platform (HDP). This box is based on Centos 7 (https://atlas.hashicorp.com/centos/boxes/7) and includes the below modifications, consistent with Hortonworks documentation (http://docs.hortonworks.com/)

Modifications

installation of the following packages
- scp
- curl
- unzip
- tar
- wget
- ntp
- openssl-devel
- gcc (required for VirtualBox Guest Additions)
- kernel-devel (required for VirtualBox Guest Additions)
- java-1.8.0-openjdk-devel.x86_64 (Java to be used by HDP, etc.)
set JAVA_HOME
enabling yum fastcache
update all yum packages and clean yum history
enabling and starting ntp
disabling firewalld
disabling transparent huge pages
disabling selinux
updating timezone to New York
increasing ulimit
updating umask

Usage

To run, execute the following

vagrant up --provider virtualbox

Release Notes

The latest release is v1.0.15. For detailed release information see https://app.vagrantup.com/timveil/boxes/centos7-hdp-base

Development Notes

Before packaging box, make sure to change both vagrant and root password to vagrant

sudo su -

# change root password
passwd 

# change vagrant password
passwd vagrant

To package and deploy see https://scotch.io/tutorials/how-to-create-a-vagrant-base-box-from-an-existing-one