PIG_Demo

General Information (access your VM):

Operating System: Mac -> Microsoft Remote Desktop, Windows -> Default Remote Desktop, Ubuntu -> Remmina
Machine: cs6304-<mst_username>-01.class.mst.edu
User: <mst_username>
Default Password: <mst_password>

Start PIG Session

Open Terminal and run following command:

pig -x local

configure PIG (if it is not already installed)

wget https://dlcdn.apache.org/pig/pig-0.17.0/pig-0.17.0.tar.gz
tar -xvf pig-0.17.0.tar.gz
mv pig-0.17.0/ /opt/pig

#Set up PIG profile
export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre
export PIG_HOME=/opt/pig
export PATH=$PATH:$PIG_HOME/bin
export PIG_CLASSPATH=$HADOOP_HOME/conf

Below part is not for the students

#we can change in .bashrc instead of exporting the path variables every time
#instead of changing at .bashrc we create script under profile.d (while doing in your own VM)
#sudo tee /etc/profile.d/pig.sh <<'EOF'
#export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre
#export PIG_HOME=/opt/pig
#export PATH=$PATH:$PIG_HOME/bin
#export PIG_CLASSPATH=$HADOOP_HOME/conf
#EOF

#Set up PIG profile(for script we need like below)
#cat >/etc/profile.d/pig.sh <<'EOF'
#export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre
#export PIG_HOME=/opt/pig
#export PATH=$PATH:$PIG_HOME/bin
#export PIG_CLASSPATH=$HADOOP_HOME/conf
#EOF

Hadoop Commands

Open new tab on the terminal

Check if Hadoop Deamons are Running:

jps

If Hadoop Daemons are not Running correctly, run following commands to stop and restart the daemons:

stop-all.sh
hadoop namenode -format
start-all.sh

Check again:

jps