m-lab/etl-gardener

Migrate to a prerequisite driven system

Opened this issue · 0 comments

Rather than being date and job oriented, with a state machine per job, move to a system where a job is a bunch of actions and prerequisites, and some jobs may have prerequisites that span multiple datatypes and other action outputs.