GoogleCloudPlatform/public-datasets-pipelines

Check for missing or incorrectly named variables during a DAG deploy

adlersantos opened this issue · 0 comments

Description

A common gotcha is when the Airflow variables are incorrectly set or missing in the .dev|.staging|.prod folders. We can catch this error upstream by checking if the variables in variables.json match the ones needed by the DAG file.

Checklist

  • I created this issue in accordance with the Code of Conduct.
  • This issue is appropriately labeled.