Count the occurrences of each word in a text file concurrently (Partitioning the text and assigning each partition to a mapper, then collecting all results in reducers)
- ZeroMQ
- zmqpp
- JSON for Modern C++ (Included in
lib/)
To compile simply type in a terminal
makeThe file config.json contains information about mappers, reducers and the partitioner. There's an example local configuration in this repository.
To run, do
./partitioner.out text./mapper.out node_name./reducer.out node_name
where
textis the file for calculating the word countnode_nameis the name of a node according toconfig.json