dags
There are 103 repositories under dags topic.
DAGWorks-Inc/burr
Build applications that make decisions (chatbots, agents, simulations, etc...). Monitor, trace, persist, and execute on your own infrastructure.
astronomer/dag-factory
Dynamically generate Apache Airflow DAGs from YAML configuration files
astronomer/astro-sdk
Astro SDK allows rapid and clean development of {Extract, Load, Transform} workflows using Python and SQL, powered by Apache Airflow.
kaxil/airflowctl
A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects
kevinsbello/dagma
A Python 3 package for learning Bayesian Networks (DAGs) from data. Official implementation of the paper "DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterization"
flyaflya/causact
causact: R package to accelerate computational Bayesian inference workflows in R through interactive visualization of models and their output.
integrated-inferences/CausalQueries
Bayesian inference from binary causal models
astronomer/astro-provider-databricks
Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows
astronomer/astro-provider-ray
This provider contains operators, decorators and triggers to send a ray job from an airflow task
AlvaroCavalcante/airflow-parse-bench
Stop creating bad DAGs! Use this tool to measure and compare the parse time of your DAGs, identify bottlenecks, and optimize your Airflow environment for better performance.
andrewheiss/closing-backdoors-dags
Use regression, inverse probability weighting, and matching to close confounding backdoors and find causation in observational data
chayansraj/Python-ETL-pipeline-using-Airflow-on-AWS
This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow orchestration tool on AWS EC2 instance.
badal-io/gcp-airflow-foundations
Opinionated framework based on Airflow 2.0 for building pipelines to ingest data into a BigQuery data warehouse
Joffreybvn/airflow-dag-builder
Airflow plugin to create/edit Dags via drag-and-drop on a convenient UI
Duntrain/dagrad
dagrad is a Python package that provides an extensible, modular platform for developing and experimenting with differentiable (gradient-based) structure learning methods.
theeye-io-team/theeye-supervisor
TheEye supervisor
ThomWright/balamb
🌱 Concurrently run a set of dependent, asynchronous tasks with type-safe dependencies
AnthonyByansi/Airflow-Data-Pipeline-Automation
Automate your data pipelines using Apache Airflow with this ready-to-use DAG for data integration, ETL and workflow automation.
kudeh/udacity-dend-capstone
Udacity Data Engineering Nanodegree Capstone Project
badubizzle/ex_dag
Experimental implementation of Airflow DAGs in Elixir
gzilles/airflow_etl
Projeto final de conclusão do Bootcamp IGTI 2021/1
Elkinmt19/airflow-master
This a repo that was created to learn more about Airflow and develop awesome data engineering projects. 🚀🚀
adaszko/roaring-graphs
Graphs backed by roaring bitmaps
remlapmot/mrdags
Code to draw DAG and SWIG figures for Mendelian randomization studies
ScopeLift/kaspa-wallet
👝 A web wallet for the Kaspa blockchain network
Polidea/dag-checks
The dag-checks consist of checks that can help you in maintaining your Apache Airflow instance.
garfado/Breweries
ETL e Transformações
ischenkx/kantoku
Distributed Computations Platform
judeleonard/Data-Engineering
This is a repo to keep track of all my projects related to data engineering
robitalec/statistical-rethinking-colearning-2024
:memo: Statistical Rethinking colearning 2024
rohan472000/covid-data-fetch-bigquery-airflow
This repo consist of codes to fetch covid data and store them into bigquery, scheduled by apache-airflow.
tuancamtbtx/airflow-on-k8s
Setup Airflow and Implement Some Operators Deployed on K8s
3amory99/Podcust-Summary-Data-Pipeline-Using-Airflow
Creating a data pipeline using Airflow. The pipeline will download podcast episodes and automatically transcribe them using speech recognition. We'll store our results in a SQLite database that we can easily query.
ahmedfarag9/airbyte-airflow-api-intergration
Api integration using Airbyte/Airflow Mega Docker Cluster - Airbyte handles the Api connection & Airflow does the orchestration.
nick-roberson/comp-blocks
Computation as Composable Blocks, can be extended to run on remote pipeline frameworks if necessary.
thaddeuscleo/airflow-docker-compose
repository is designed to facilitate the development of Apache Airflow DAGs