/BigDataEnvSetup

Big Data and Machine Learning Environment Setup for Ubuntu 16.04

Primary LanguageShell

Big Data Environmet Setup for Ubuntu 16.04

This setup includes following:

  • HADOOP_VERSION=3.1.0
  • SPARK_VERSION=2.3.0
  • ZOOKEEPER_VERSION=3.4.12
  • KAFKA_VERSION=1.1.0
  • SCALA_VERSION=2.12
  • AMBARI_VERSION=2.6.1.5
  • R_VERSION= Last Version in OS Package Manager
  • RSTUDIO_VERSION=1.1.447
  • ANACONDA2_VERSION=5.1.0
  • ANACONDA3_VERSION=5.1.0
  • TENSORFLOW_VERSION=1.8.0

Python Libraries:

  • jupyter
  • matplotlib
  • numpy
  • pandas
  • scipy
  • scikit-learn

IMPORTANT

  • user=data should be changed to the appropriate OS User. Also the versions of all the apps can be changed via this .sh file