ucla-oarc-hpc/WS_BigDataOnHPC

Big Data on HPC workshop

Big Data on HPC workshop

Charles Peterson, OARC

This workshop will go over using Big Data techniques on HPC resources. Big Data methods are used when data size because so large, it becomes challenging to compute. Also, when machine learning models become so complex, it can also be challenging to train. In this workshop, we will go over examples of solving Big Data problems on UCLA’s HPC resource Hoffman2. This is an introductory workshop is intended to showcase various Big Data software and libraries, such as, Spark and Dask.

For workshop prerequisites, look at INTRO.md

View this workshop at

• HTML version - https://ucla-oarc-hpc.github.io/WS_BigDataOnHPC

• PDF version - BigDataHPC.pdf

• Quarto file - BigDataHPC.qmd

For any questions, email cpeterson@oarc.ucla.edu