This repository contains the terraform and ansible necessary to create and maintain the Galaxy Australia ecosystem. The contents of this repository are very specific to Galaxy Australia and are not general in any way.
Galaxy Australia can be accessed at: https://usegalaxy.org.au
If you wish to use Ansible and Terraform for your own Galaxy server then head over to the Galaxy Project's Git Hub for more resources or checkout the amazing range of Galaxy Administration with Ansible tutorials located at the Galaxy Training Network's site.
Galaxy Australia currently runs a number of instances and nodes, mostly on cloud resources using Openstack. They currently are:
- Galaxy Australia - the main server
- Located at the Pawsey Supercomputing Centre
- Playbooks predicated with "pawsey-"
- Galaxy Australia Staging - the tool testing server
- Located at the University of Melbourne
- Playbooks predicated with "staging-"
- Galaxy Australia Dev - the development server
- Located at the University of Melbourne
- Playbooks predicated with "dev-"
- Pulsar Mel - Pulsar cluster dedicated to training jobs
- Located at the University of Melbourne
- Pulsar Mel3 - Pulsar cluster dedicated to long running and large jobs
- Located at the University of Melbourne
- Pulsar Paw - Pulsar cluster dedicated to COVID-19 analysis
- Located at the Pawsey Supercomputing Centre
- Pulsar NCI - Pulsar cluster used for various jobs ranging from training to general capacity
- Located at NCI in Canberra (National Computational Infrastructure)
We use Terraform to instantiate all of our VMs. Instructions for the installation of Terraform can be found here.
The terraform files contained here are for each of the clusters in the Galaxy Australia ecosystem. They also require the appropriate Openstack credentials file to be sourced before running.
To run the terraform scripts, go to the appropriate subfolder and test with:
terraform planThis will show you what changes will be made. Once satisfied use:
terraform apply
These playbooks are designed for Ansible versions 2.9 and above.
Installation instructions for Ansible can be found here
Most of the roles used here are from Ansible Galaxy
They are all listed in the requirements.yml file. They can be installed locally with the ansible-galaxy command.
ansible-galaxy install -p roles -r requirements.ymlThere are a few custom roles associated with these playbooks. They are:
| Role name | Purpose |
|---|---|
| common | Performs common tasks on our virtual machines including setting up users, installing some required packages amongst other tasks |
| mariadb | Sets up MariaDB for Slurm accounting on various clusters |
| mounts | Sets up NFS mounts for various clusters |
| pg-post-tasks | Adds some users and extra permissions to the Galaxy Database |
| slg.db-backup | Role to setup database backups for Galaxy Australia |
| slg.galaxy_stats | Sets up collection of statistics from Galaxy for Grafana |
Each playbook can be run with:
ansible-playbook -i hosts --vault-password-file <vault-password-file> --private-key <ssh_key> <playbook>where you supply the <vault-password-file>, the <ssh_key> and the playbook you want to run.
All contributions to these playbooks are to be made by pull request.
We strongly suggest you fork the repository.
Detailed instructions on modifying the tool destinations for jobs is located here
This repository is maintained by the Galaxy Australia team.
Credits:
The documentation/instructions for the Galaxy Australia implementation of Galaxy Europe's TIaaS system can be found here
 |
 |
|---|