/hadoop_bandwidth_measurement

Bandwidth measurements for uploading and downloading files with different sizes.

Primary LanguageJava

hadoop_bandwidth_measurement

Project Setup

The setup for this project is available in the following link: https://github.com/green-spark/bigdata-learning/wiki/Hadoop-setup---Single--node-cluster

Build the app

make build

Run the app

make run-upload LOCAL_PATH=/local/directory/to/be/uploaded HADOOP_PATH=/hadoop/path/to/upload
make run-download LOCAL_PATH=/local/path/to/download HADOOP_PATH=/hadoop/directory/to/be/downloaded

Clean the app

make clean

Generate data

Run the script generate_files.sh in order to generate the files for upload.

./generate_files.sh