airflow-operators
There are 69 repositories under airflow-operators topic.
san089/Udacity-Data-Engineering-Projects
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
astronomer/astronomer-cosmos
Run your dbt Core or dbt Fusion projects as Apache Airflow DAGs and Task Groups with a few lines of code
tomasfarias/airflow-dbt-python
A collection of Airflow operators, hooks, and utilities to elevate dbt to a first-class citizen of Airflow.
astronomer/airflow-provider-great-expectations
Great Expectations Airflow operator
astronomer/astronomer-providers
Airflow Providers containing Deferrable Operators & Sensors from Astronomer
gestaogovbr/FastETL
Airflow plugins for implementing data pipelines. | Plugins do Airflow para implementação de pipelines de dados.
sergio11/lyric_wave_architecture
🎵 LyricWave – AI Music Composer (Proof of Concept) 🎶 A personal project exploring automatic generation of unique MP4 songs. LyricWave blends lyrics with AI-generated melodies and synthetic vocals to experiment with new forms of musical expression. A creative testbed to push your ideas into sound. 🚀🎧
mikeroyal/Apache-Airflow-Guide
Apache Airflow Guide
debussy-labs/debussy_concert
Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.
hightouchio/airflow-provider-hightouch
Airflow operators, hooks, and sensors for interacting with the Hightouch API
tensor365/AIRFLOW-QLIKSENSE-CLOUD
Qlik Sense Cloud Provider for Apache Airflow
airflow-laminar/airflow-common
Common Airflow Operators / Tasks
angadsingh/airflow-hdinsight
HDInsight provider for Airflow
astronomer/astro-provider-anyscale
An Apache Airflow provider for seamless integration with Anyscale.
DataDrivenGit/Music-Streaming-App-using-AWS-ETL
Implemented Data Warehouse, Data Lake on AWS and Data modeling with Postgres and Apache Cassandra, Also used Apache Airflow to create data pipeline
hereiamken/Udacity-Data-Engineering
All projects from Udacity Data Engineering Course
Amsterdam/dataservices-airflow
Airflow docker container for Dataservices.
jaiswalanshul/gcp_dataproc_spark_airflow
Data Workflows with GCP Dataproc, Apache Airflow and Apache Spark
lynker-analytics/airflow-conda-operator
Airflow task & operator running python code in conda/mamba environments
sdaberdaku/apache-airflow-providers-pysparkonk8s
Python package for the pysparkonk8s Apache Airflow provider.
tiwariswapnil/airflow
A project of Airflow DAGs created using Airflow operators
AfonsoFeliciano/Forex-Data-Pipeline
POC do curso Apache Airflow: The Hands-On Guide utilizando dados de paridade de moedas financeiras
An4PDM/Airflow_basico
Repositório com conceitos básicos de Airflow e criação de DAGs.
An4PDM/Aprendendo-a-criar-DAGs
Este repositório tem objetivo de organizar todas as DAGs que estou criando para fim de consultas posteriores.
augusto-herrmann/FastETL
Common functionality for implementing data flows in Apache Airflow DAGs.
Cori1109/airflow-provider-hightouch
Airflow operators, hooks, and sensors for interacting with the Hightouch API
emsalcengiz/Etl_processing
I find Apache Airflow very useful for ETL work. Here I transferred data from the source database(mysql) to the target database(postresql) and used the Airflow Bash Operator.
essien1990/ETL_Pipeline_Airflow
Creating pipelines using Python3 and Apache Airflow to load tables into Google Big Query Dataware House
Giray18/etl-s3-airflow-snowflake-powerbi-marketing-data
A end to end data analytics work that consumes data from AWS S3, executing ETL process and creating datamart on Snowflake following to that a PowerBI report created by using datamart
IgnacioNMiranda/trigger-dag-run-params-demo
Apache Airflow demo project that setup 3 DAGs to explain how to pass parameters from a DAG to a triggered DAG.
kuldeep27396/airflow-projects-deployed
This project contains a comprehensive collection of Apache Airflow DAGs designed for learning Airflow concepts from basics to advanced levels. The project includes 25 different DAGs covering various operators, patterns, and production scenarios, all deployed and tested using Astronomer Cloud.
osule/lard
An operator for performing the Extract and Load bit of the ELT data pipeline in an Apache Airflow workflow.
shiv-rna/Airflow-Basics
Welcome to my Apache Airflow learning journey repository! 🚀 This repository serves as a comprehensive documentation of my exploration and understanding of Apache Airflow, an open-source platform for orchestrating complex workflows.
sp1thas/airflow-provider-kaggle
[MIRROR OF https://codeberg.org/sp1thas/airflow-provider-kaggle] Airflow operators and hooks for interacting with the Kaggle API
WilsonH918/Data_Pipeline_ETL_Pipeline_Web3_Token
Data Pipeline Project