/magpie

Magpie contains a number of scripts for running Big Data software in HPC environments. Thus far, Hadoop, Hbase, Pig, Spark, Storm, Tachyon, and Zookeeper are supported. It currently supports running over the schedulers of Slurm and Moab, and the resource managers of Slurm and Torque. It currently supports running over the parallel file system Lustre and running over any generic network filesytem.

Primary LanguageShellGNU General Public License v2.0GPL-2.0

Watchers