astronomer/astro-sdk

Potential issue with `cleanup` and Airflow 2.6

fritz-astronomer opened this issue · 2 comments

fritz-astronomer commented

Describe the bug

  File "/usr/local/lib/python3.10/site-packages/astro/sql/operators/cleanup.py", line 189, in _get_executor_from_job_id
    from airflow.jobs.base_job import BaseJob
ModuleNotFoundError: No module named 'airflow.jobs.base_job'

Version

  • Astro Runtime: 8.0
tatiana commented

Hi @fritz-astronomer ! Could you confirm the version of the Python SDK you're using?

There were compatibility issues between the SDK 1.5.x with Airflow 2.6 - but this has been addressed on the SDK 1.6 release. I reached out to the Runtime team so we can update this.

In the meantime, can you override the SDK version for the latest stable release (astro-sdk-python==1.6) in your environment and confirm if the cleanup operator works as expected?

fritz-astronomer commented

we had been on 1.4.1 - bumping and testing