/WebHDFSClient

Big Data project. Web client for HDFS. Working in the terminal. Has ability to manipulate local and Hadoop storage

Primary LanguagePythonMIT LicenseMIT

Web HDFS Client

Setup

Download and install Python.

Download and install Ubuntu

Download and install Hadoop

Run this followed commands:

git clone https://github.com/sinevmaxim/WebHDFSClient.git

$HADOOP_HOME/opt/hadoop/sbin/start-dfs.sh

$HADOOP_HOME/opt/hadoop/sbin/start-yarn.sh

nano conf.json
# INSERT YOUR HADOOP HDFS IP ADDRES, PORT AND USER

sudo nano /private/etc/hosts
# ADD LOCAL HADOOP HOST ADDRESS AND HOST NAME

python3 web_hdfs_client.py