apache-airflow
There are 690 repositories under apache-airflow topic.
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
jghoman/awesome-apache-airflow
Curated list of resources about Apache Airflow
elyra-ai/elyra
Elyra extends JupyterLab with an AI centric approach.
teamclairvoyant/airflow-maintenance-dags
A series of DAGs/Workflows to help maintain the operation of Airflow
san089/goodreads_etl_pipeline
An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.
astronomer/dag-factory
Construct Apache Airflow DAGs Declaratively via YAML configuration files
astronomer/astronomer-cosmos
Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code
tuanavu/airflow-tutorial
Apache Airflow tutorial
couler-proj/couler
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.
astronomer/astronomer
Helm Charts for the Astronomer Platform, Apache Airflow as a Service on Kubernetes
andreax79/airflow-code-editor
A plugin for Apache Airflow that allows you to edit DAGs in browser
apache/airflow-client-python
Apache Airflow - OpenApi Client for Python
blockchain-etl/ethereum-etl-airflow
Airflow DAGs for exporting, loading, and parsing the Ethereum blockchain data. How to get any Ethereum smart contract into BigQuery https://towardsdatascience.com/how-to-get-any-ethereum-smart-contract-into-bigquery-in-8-mins-bab5db1fdeee
astronomer/astro-cli
CLI that makes it easy to create, test and deploy Airflow DAGs to Astronomer
astronomer/astro-sdk
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
airflow-plugins/Example-Airflow-DAGs
Example DAGs using hooks and operators from Airflow Plugins
teamclairvoyant/airflow-rest-api-plugin
A plugin for Apache Airflow that exposes rest end points for the Command Line Interfaces
GoogleCloudPlatform/airflow-operator
Kubernetes custom controller and CRDs to managing Airflow
astronomer/airflow-chart
A Helm chart to install Apache Airflow on Kubernetes
airscholar/e2e-data-engineering
An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.
tkp-archive/paperboy
A web frontend for scheduling Jupyter notebook reports
teamclairvoyant/airflow-scheduler-failover-controller
A process that runs in unison with Apache Airflow to control the Scheduler process to ensure High Availability
kaxil/airflowctl
A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
apache/airflow-client-go
Apache Airflow - OpenApi Client for Go
xnuinside/airflow_in_docker_compose
Apache Airflow in Docker Compose (for both versions 1.10.* and 2.*)
rolanddb/airflow-on-kubernetes
A guide to running Airflow on Kubernetes
Toloka/dbt-af
Distributed run of dbt models using Airflow
airscholar/RedditDataEngineering
This project provides a comprehensive data pipeline solution to extract, transform, and load (ETL) Reddit data into a Redshift data warehouse. The pipeline leverages a combination of tools and services including Apache Airflow, Celery, PostgreSQL, Amazon S3, AWS Glue, Amazon Athena, and Amazon Redshift.
gestaogovbr/Ro-dou
Gerador de DAGs no Apache Airflow para fazer clipping do Diário Oficial da União.
astronomer/astronomer-providers
Airflow Providers containing Deferrable Operators & Sensors from Astronomer
ninja-van/airflow-boilerplate
A complete development environment setup for working with Airflow
datacamp/viewflow
Viewflow is an Airflow-based framework that allows data scientists to create data models without writing Airflow code.
Wittline/uber-expenses-tracking
The goal of this project is to track the expenses of Uber Rides and Uber Eats through data Engineering processes using technologies such as Apache Airflow, AWS Redshift and Power BI.
idealista/airflow-role
Ansible role to install Apache Airflow
PowerDataHub/terraform-aws-airflow
Terraform module to deploy an Apache Airflow cluster on AWS, backed by RDS PostgreSQL for metadata, S3 for logs and SQS as message broker with CeleryExecutor
caoergou/airflow-extended-api-plugin
Yet another Airflow plugin using CLI command as RESTful api, supports Airflow v2.X.