Basic Python introduction and concepts needed in preparation for working with map-reduce solutions.
- Install Chocolatey, the Windows package manager
- Install the Anaconda 3 version for Python + common packages
- Install Visual Studio Code for text editing
- Add Open Command Window Here as Administrator to your File Explorer context menu.
py 11mapper.py
py 12sorter.py
py 13reducer.py
Use the console (standard input and output) and shell commands to pipe information. We'll use the built-in shell sort command, so we don't need that anymore.
cat data | map | sort | reduce
PowerShell and Bash use the same commands:
cat part.txt
cat part.txt | python 21mapper.py
cat part.txt | python 21mapper.py | sort
cat part.txt | python 21mapper.py | sort | python 22reducer.py
cat purchases.txt
cat purchases.txt | python 21mapper.py
cat purchases.txt | python 21mapper.py | sort
cat purchases.txt | python 21mapper.py | sort | python 22reducer.py