/ganga-profile

Snakemake profile for HTCondor

Primary LanguagePythonMIT LicenseMIT

HTCondor Snakemake profile

This profile configures Snakemake to submit jobs to the grid via DIRAC. This is primarily aimed for users of CERN/ganga.

Prerequisites

Assumes you have valid access to DIRAC.

Deploy profile

To deploy this profile run

mkdir -p ~/.config/snakemake
cd ~/.config/snakemake
cookiecutter https://github.com/Snakemake-Profiles/htcondor.git

You will be asked for the name of the profile and for a path where the HTCondor logs will be stored. The logs will be used to update the status of submitted jobs (as recommended in the documentation of the HTCondor Python bindings).

Then, you can run Snakemake with

snakemake --profile ganga_dirac ...

so that jobs are submitted to the cluster. If Snakemake is killed and restarted afterwards, it will automatically resume still running jobs.