Oracy/haddop_spark_configuration

Configure Hadoop and Spark

Softwares that will be installed:

First Step:

• Create Virtual Machine;
• Install LinuxOS;
• Install utilities (java, ssh, tools);
• Install MySQL.

Second Step:

• Install Hadoop;
• Configure HDFS and MapReduce;
• Execute MapReduce Job in HDFS;
• Configure Yarn;
• Install and configure Zookeeper;
• Install and configure Hbase;
• Install and configure Hive;
• Install and configure Pig;
• Install and configure Spark;
• Install and configure Sqoop;
• Install and configure Flume.
• Install Anaconda

Install and configure Cloudera VM;
Install and configure Hortonworks VM;
Install and configure Hadoop Namenode with Docker;
Install and configure Hadoop Slave with Docker;
Install and configure Hadoop Datanode with Docker.