/MPI-IO-SPARTAN-Cluster

This is a Python script to perform a word count of a 10 GB file full of tweets stored on the University of Melbourne's Hybrid cluster system - SPARTAN, using multiple cores and nodes. This program facilitates this process through the functionality of parallel read that MPI-IO provides. The job is submitted onto the cluster using Slurm.

Primary LanguagePython

Stargazers