/Hadoop-Clustering-Docker-Guide

Hadoop-Clustering-Docker-Guide : A Complete Documentation to setting up Hadoop and try clustering.

Primary LanguageJava

------ 🧠 For Lab Exam : This step are enough 🧠 ------

🌲 Hadoop Clusterting using Docker

✍️ Follow Every Blog Instruction of মেহরাজুল ইসলাম : (👉Click Here)

✍️ To Run Hadoop Docker using Your Project Jar File : (👉Click Here)

✍️ 19 Lab Final Question + Answer : (👉Click Here)

------ 🎥 Video Tutorial of Blog : Rifat Shariar Sakil 🎥 ------

✍️ Video of Blog Steps 1 - 5 : (👉Click Here)
✍️ Video of Blog Steps 6 - 10 : (👉Click Here)
✍️ Video of Blog Steps 11 - 13 : (👉Click Here)

-- 🧠 Do The Below Steps if only want to see how hadoop works 🧠 --

🎥 Tutorial Installation of Hadoop

🧠 Follow Every Instruction Carefully (👉Click Here)

✅ Download Links

🧠 Java - 8 (Must Needed) : (👉Click Here)

🧠 Apache Hadoop : (👉Click Here)

🧠 Notepad++ Editor : (👉Click Here)

🧠 Hadoop Fixed Bin Folder : (👉Click Here)

🧠 Hadoop All Version Bin Folder Fixed : (👉Click Here)

🧠 Microsoft Visual C++ Redistributable : (👉Click Here)

👩‍💻 Code : Setting up Hadoop (👉Click Here)

👉 For core-site.xml

<property>
  <name>fs.defaultFS</name>
  <value>hdfs://localhost:9000</value>
</property>

👉 For mapred-site.xml

<property>
  <name>mapreduce.framework.name</name>
  <value>yarn</value>
</property>

👉 For hdfs-site.xml or https-site.xml

<property>
  <name>dfs.replication</name>
  <value>1</value>
</property><property>
  <name>dfs.namenode.name.dir</name>
  <value>C:\hadoop\data\namenode</value>
</property><property>
  <name>dfs.datanode.data.dir</name>
  <value>C:\hadoop\data\datanode</value>
</property>

👉 For yarn-site.xml

<property>
  <name>yarn.nodemanager.aux-services</name>
  <value>mapreduce_shuffle</value>
</property><property>
  <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
  <value>org.apache.hadoop.mapred.ShuffleHandler</value>
</property>

✅ Testing : Haadoop Properly Installed or Not

Method - 1 : 👉 Opem CMD Terminal

hdfs namenode -format

cd \

cd hadoop

cd sbin

start-dfs.cmd

cd jps

start-yarn.cmd

cd jps

Method - 2 : 👉 Download The Folder and Run The Project in Intellij

🧠 Video Link of Class (👉Click Here)
🧠 Project Code (👉Click Here)

🎥 Docker Installation

🧠 Install Docker on Window 11 (👉Click Here)

🧠 Docker Guide and Basic Information (👉Click Here)