This is an Apptainer definition file that creates an Ubuntu 22.04 system with NVIDIA CUDA 12.2 support. It's intended to be used on the Digital Research Alliance of Canada's compute stack (I test on Cedar, but it should probably work on any of DR's machines).
To build:
Install Apptainer into your OS.
Build with apptainer build ubuntu-nvidia-12.2.sif ubuntu-nvidia-12.2.def
If you require pytorch and axolotl for finetuning LLMs, build with apptainer build ubuntu-pytorch-axolotl-nvidia-12.2.sif ubuntu-pytorch-axolotl-nvidia-12.2.def
Note that Digital Research's CUDA level may change, in which case I'll have to rebuild this with the appropriate CUDA. To check the CUDA level on any machine that has CUDA support, run the command nvidia-smi -q.
Don't try to build this on DRAC's infrastructure -- the network filesystems do not support sandbox Apptainer files which are necessary for the build process. The SIF file created by the build process will work just fine on DRAC, just not sandbox or builds themselves.