This repository contains tutorials and guides of running Kueue based High Performance Computing / Batch infrastructure on Google Kubernetes Engine.
The guides and tutorials are targeted for someone planning to run batch workloads on Kubernetes clusters and wants to learn how it can be done with Kueue and Google Kubernetes Engine.
Some of the labs are based on the following scenario: the batch compressor jobs are created by the
dispatcher application. This happens based on the events from Cloud Storage bucket.
Next, the compressor job compresses objects from inbox directory and stores compressed results in
the processed directory.
The terraform directory contains the code for setting up the required infrastructure.
The dispatcher directory contains the code of the dispatcher application.
The compressor directory contains the code of the compressor application.
The assets directory contains extra assets like Grafana monitoring dashboards for Kueue.