Count the occurrences of each word in a text file concurrently (Partitioning the text and assigning each partition to a mapper, then collecting all results in reducers)
- ZeroMQ
- zmqpp
- JSON for Modern C++ (Included in
lib/
)
To compile simply type in a terminal
make
The file config.json
contains information about mappers, reducers and the partitioner. There's an example local configuration in this repository.
To run, do
./partitioner.out text
./mapper.out node_name
./reducer.out node_name
where
text
is the file for calculating the word countnode_name
is the name of a node according toconfig.json