Scheduled metadata ingestions managed by DataHub
tom-webber opened this issue · 0 comments
tom-webber commented
As of ministryofjustice/data-catalogue-metadata#6, the DataHub instances are able to fetch metadata from the production glue, athena, and dbt sources.
We should set up any ingested metadata to run on a schedule to collect fresh metadata.
Context:
Currently there's a failing ingestion ('CaDeT latest') in dev, but I've not delved into what's causing the failure