workflow-orchestration
There are 32 repositories under workflow-orchestration topic.
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
apache/dolphinscheduler
Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code
DataTalksClub/mlops-zoomcamp
Free MLOps course from DataTalks.Club
The-Pocket/PocketFlow
Pocket Flow: 100-line LLM framework. Let Agents build Agents!
akuity/awesome-argo
A curated list of awesome projects and resources related to Argo (a CNCF graduated project)
harshadmanglani/polaris
Polaris: High performance workflow orchestrator for Golang
terrytangyuan/awesome-kubeflow
A curated list of awesome projects and resources related to Kubeflow (a CNCF incubating project)
zetane/ZetaForge
Open source AI platform for rapid development of advanced AI and AGI pipelines.
czelabueno/jai-workflow
Build programmatically custom agentic workflows, AI Agents, RAG systems for java
sartography/spiff-arena
SpiffWorkflow is a software development platform for building, running, and monitoring executable diagrams
hadron-project/hadron
The Kubernetes native and CloudEvents native distributed event streaming, event orchestration & messaging platform
Nerdward/Mlops_project
An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts storage. AWS Lambda/ ECR for serverless model serving. AWS REST API gateway as endpoint to lambda function. GitHub Actions for CI/CD.
clamp-orchestrator/clamp-core
A microservices flow orchestrator and workflow manager.
cmigpereira/mlops-zoomcamp-project
Repo for my MLOps Zoomcamp project
node-m2m/m2m
m2m is a node.js library for developing machine-to-machine and edge applications using the node-m2m framework.
anna-geller/kestra-terraform-examples
Bring Infrastructure as Code best practices to your data workflows with Kestra and Terraform
functionless/eventual-eda-patterns
examples of Event-Driven Architectures (EDA) and Domain Driven Design (DDD) patterns implemented using eventual
pizofreude/de-zoomcamp
This repository contains learning materials and notes for the Data Engineering Zoomcamp by Datatalks.Club.
ashkan-mokarian/mlops-zoomcamp
Notes, homeworks, and projects for MLOps Zoomcamp @ datatalks.club
dev-abuke/Scalable_Backtesting_Infrastructure_for_Crypto_Trading
Our startup, Mela, aims to simplify cryptocurrency trading for everyone and provide reliable investment sources while mitigating risks. We aim to design and build a reliable, large-scale trading data pipeline that can run various backtests and store useful artifacts in a robust data warehouse.
beam-engine/core
State Machine Core Package
capstone-tim-7-alterra/data-pipeline
Data Engineering Services for Alterra Academy Capstone Project - Team 7
ddeutils/ddeutil-workflow
🏃 Lightweight Workflow Orchestration
Francisco-Montanez/snowforge-py
simplify the creation and management of Snowflake objects and data pipeline processes
ManthanShettigar/mlops_Zoomcamp_2023
mlops zoomcamp 2023 solutions
topahande/data-engineering-project
Video games sales
AbhishekRS4/Data_Ingestion_Prefect
Data Ingestion pipeline orchestration with Prefect
apache/airflow-publish
Publishing PyPI packages for Apache Airflow
codex-0915/mlops-zoomcamp
This repository contains the notes, practice and sample outputs, homeworks, etc, from DataTalks.Club's MLOps Zoomcamp 2024 Cohort
SayamAlt/Formula-1-Data-Ingestion-Transformation---ETL-Pipeline
This project demonstrates a complete ETL pipeline for Formula 1 racing data using Azure Databricks, Delta Lake, and Azure Data Factory. It covers data ingestion, transformation with PySpark and Spark SQL, data governance with Unity Catalog, and visualization through Power BI. Designed to showcase real-world data engineering workflows in Azure.