For Christmas 2023 🎄, I decided to treat myself with creating a Raspberry Pi Cluster. This repository documents my experience building it, and the fun I have been up to.
Please see pages:
Broad aims, with some sprinkling of motivations-will add more as I run more interesting tasks on it:.
- create a test bench to understand concepts and techniques around:
- parallel and concurrent programming
- node clustering
- task distribution
- basic benchmarking of task performance
- gain familiarity with configuration of linux environments
- gain familiarity with HPC task distribution software like SLURM
- gain familiarity with Message Passing Interface (MPI)
- spawn and coordinate processes across nodes
- write a minimal python script that uses OpenMPI
- use Dask to perform tasks over a cluster
- create an isolated, controllable test bench
- protects my main computer from any mishaps
- helps me report an update-to-date instruction (Dec 2023)
- explain and highlight interesting details
- remind me / reflect on the approach should I try it again or something related
- Big topic that can't be left out, TBC
None of this was possible without the amazing guides, conferences and
documentation available online. For more details, please see the
ACKNOWLEDGEMENTS and
further-reading pages.