AbsaOSS/pramen

Add the ability to continue with dependent jobs even if validation failed for previous jobs.

Closed this issue · 0 comments

Background

Currently, if a job fails validation, all dependent jobs won't even attempted to be ran. Sometimes dependent jobs can be more robust and adaptive to dependent job failures and it is desirable to still allow them to run.

Feature

Add the ability to continue with dependent jobs even if validation failed for previous jobs.

Proposed Solution

Add a flag on the operation definition level that allows jobs to run even if dependent jobs failed.

operations = [
  { 
    #...
    always.attempt = "true"
  }
]