datopian/aircan

[Refactor] DAGs

hannelita opened this issue · 1 comments

hannelita commented

Acceptance

  • Receive a description JSON file and obtain resource info (file and fields) from there
  • Pass CKAN env info when triggering DAG
  • No duplicate tasks for the multiple DAGs we have
  • Organize DAGs in subdirectories

Tasks

Relates to #30

hannelita commented

Several PRs #71, #83 and ckannext-aircan #9 solve this issue.
Note: It would be good to have a DAG refactor task from time to time