astronomer/astro-provider-databricks

Repair All failed run - inconsistent behaviour

Opened this issue · 0 comments

Issue: I have 3 task which is wrapped under single Databricks cluster group and when one of the task fails and when using 'Repair All failed task' from Launch activity, sometimes the Airflow UI for the DAG shows as failed but in the backend the Repair is actually going on in Databricks, its quite wierd that sometime it works fine in the UI, but mostly it shows as failed only

Airflow 2.6.2 running in AKS using open source Helm chart.