We are working on designing and implementing distributed sorting algorithm with Scala.
You can check out the design docs and weekly progress logs.
- First, build the project. The commands below create worker.jar and master.jar.
sbt "worker/assembly"
sbt "master/assembly"- Now run the scripts.
For master,
./master.sh <# of slaves> [rpc port to bind to]For slave,
./slave.sh <master IP address>:<master rpc port> -I <input directory> [input directory...] -O <output directory> [-P <inter-slave rpc port>]