pipelines
There are 1350 repositories under pipelines topic.
Avaiga/taipy
Turns Data and AI algorithms into production-ready web applications in no time.
argoproj/argo-workflows
Workflow Engine for Kubernetes
mage-ai/mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
concourse/concourse
Concourse is a container-based automation system written in Go. It's mostly used for CI/CD.
zenml-io/zenml
ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.
orchest/orchest
Build data pipelines, the easy way 🛠️
polyaxon/polyaxon
MLOps Tools For Managing & Orchestrating The Machine Learning LifeCycle
ploomber/ploomber
The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️
argoproj/argo-events
Event-driven Automation Framework for Kubernetes
salesforce/TransmogrifAI
TransmogrifAI (pronounced trăns-mŏgˈrə-fī) is an AutoML library for building modular, reusable, strongly typed machine learning workflows on Apache Spark with minimal hand-tuning
meltano/meltano
Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.
elyra-ai/elyra
Elyra extends JupyterLab with an AI centric approach.
JuliaAI/MLJ.jl
A Julia machine learning framework
AgnostiqHQ/covalent
Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.
natayadev/dataengineering-roadmap
Un repositorio más con conceptos básicos, desafíos técnicos y recursos sobre ingeniería de datos en español 🧙✨
stacksimplify/azure-aks-kubernetes-masterclass
Azure AKS Kubernetes Masterclass
substantic/rain
Framework for large distributed pipelines
onepanelio/onepanel
The open source, end-to-end computer vision platform. Label, build, train, tune, deploy and automate in a unified platform that runs on any cloud and on-premises.
tenzir/tenzir
Tenzir is the data pipeline engine for security teams.
JulianKemmerer/PipelineC
A C-like hardware description language (HDL) adding high level synthesis(HLS)-like automatic pipelining as a language construct/compiler feature.
Azure/azure-devops-cli-extension
Azure DevOps Extension for Azure CLI
pypyr/pypyr
pypyr task-runner cli & api for automation pipelines. Automate anything by combining commands, different scripts in different languages & applications into one pipeline process.
mdubourg001/glci
🦊 Test your Gitlab CI Pipelines changes locally using Docker.
tektoncd/triggers
Event triggering with Tekton!
live-keys/livekeys
Livekeys - Automation Platform with support for live scripting.
microsoft/psi
Platform for Situated Intelligence
acln0/zerocopy
Zero-copy I/O primitives and pipelines for Go. Linux-specific.
timoschwarzer/gitlab-monitor
A web-based monitor dashboard for GitLab CI
pipefunc/pipefunc
Lightweight fast function pipeline (DAG) creation in pure Python for scientific (HPC) workflows 🕸️🧪
harness/drone-cli
Command Line Tools for Drone CI
smooks/smooks
An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration
thomhurst/ModularPipelines
Write your pipelines in C# !
meta-pytorch/torchx
TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
nf-core/modules
Repository to host tool-specific module files for the Nextflow DSL2 community!
rosineygp/mkdkr
mkdkr = Makefile + Docker
calebwin/pipelines
An experimental programming language for data flow