/docker-luigi

Luigi on Docker, using conda

Primary LanguageShell

Luigi on Docker

Luigi death stare

Versions

  • axiom/docker-luigi:latest (2.7.1)
  • axiom/docker-luigi:2.7.1
  • axiom/docker-luigi:2.7.0
  • axiom/docker-luigi:2.6.2
  • axiom/docker-luigi:2.6.1
  • axiom/docker-luigi:2.3.1

Exposed Volumes

/etc/luigi/

Both luigi and luigid load their configuration from /etc/luigi/.

  • Configuration: /etc/luigi/luigi.conf
  • Logging: /etc/luigi/logging.conf

Mount a directory containing a luigi.conf and logging.conf file(s) to /etc/luigi to provide your own configuration(s).

docker run \
    -v /your/directory:/etc/luigi \
   axiom/docker-luigi

Or mount a single configuration file:

docker run \
    -v /your/directory/logging.conf:/etc/luigi/logging.conf \
   axiom/docker-luigi

The default can be found in the luigi.conf and logging.conf files in this repository. Be aware that these specify the paths to the logging configration and the state persistence database. If you change these values in luigi.conf the examples in this document will not work!

/luigi/state

Mount a volume at /luigi/state for the luigid state to be persisted between restarts. Example below uses a named docker volume to persist the state:

docker run \
    -v luigistate:/luigi/state \
    axiom/docker-luigi