pipeline
There are 4883 repositories under pipeline topic.
jina-ai/jina
☁️ Build multimodal AI applications with cloud-native stack
vectordotdev/vector
A high-performance observability data pipeline.
argoproj/argo-cd
Declarative Continuous Deployment for Kubernetes
PrefectHQ/prefect
Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines
airbytehq/airbyte
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
great-expectations/great_expectations
Always know what to expect from your data.
PRQL/prql
PRQL is a modern language for transforming data — a simple, powerful, pipelined SQL replacement
kedro-org/kedro
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.
Avaiga/taipy
Turns Data and AI algorithms into production-ready web applications in no time.
tektoncd/pipeline
A cloud-native Pipeline resource.
tc39/proposal-pipeline-operator
A proposal for adding a useful pipe operator to JavaScript.
mage-ai/mage-ai
🧙 Build, run, and manage data pipelines for integrating and transforming data.
projectdiscovery/httpx
httpx is a fast and multi-purpose HTTP toolkit that allows running multiple probes using the retryablehttp library.
brunch/brunch
:fork_and_knife: Web applications made easy. Since 2011.
kestra-io/kestra
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.
nteract/papermill
📚 Parameterize, execute, and analyze notebooks
gaia-pipeline/gaia
Build powerful pipelines in any programming language.
iam-veeramalla/Jenkins-Zero-To-Hero
Install Jenkins, configure Docker as slave, set up cicd, deploy applications to k8s using Argo CD in GitOps way.
jenkins-x/jx
Jenkins X provides automated CI+CD for Kubernetes with Preview Environments on Pull Requests using Cloud Native pipelines from Tekton
gonglei007/GameDevMind
最全面的游戏开发技术图谱。帮助游戏开发者们在已知问题上节省时间，省出更多的精力投入到更有创造性的工作中去。
marimo-team/marimo
A reactive notebook for Python — run reproducible experiments, execute as a script, deploy as an app, and version with git.
alirezadir/Production-Level-Deep-Learning
A guideline for building practical production-level deep learning systems to be deployed in real world applications.
kubeflow/pipelines
Machine Learning Pipelines for Kubeflow
towhee-io/towhee
Towhee is a framework that is dedicated to making neural data processing pipelines simple and fast.
EpicGamesExt/BlenderTools
Blender addons that improve the game development workflow between Blender and Unreal.
tencentmusic/cube-studio
cube studio开源云原生一站式机器学习/深度学习AI平台，支持sso登录，多租户/多项目组，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，serverless，标注平台，自动化标注，数据集管理，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式
nextflow-io/nextflow
A DSL for data-driven computational pipelines
yuanzhoulvpi2017/zero_nlp
中文nlp解决方案(大模型、数据、模型、训练、推理)
alibaba/pipcook
Machine learning platform for Web developers
EntilZha/PyFunctional
Python library for creating data pipelines with chain functional programming
mara/mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
firecow/gitlab-ci-local
Tired of pushing to test your .gitlab-ci.yml?
instill-ai/instill-core
🔮 Instill Core is an open-source no-/low-code data, model and pipeline orchestration platform, providing a full-stack solution for AI-first applications
hu17889/go_spider
[爬虫框架 (golang)] An awesome Go concurrent Crawler(spider) framework. The crawler is flexible and modular. It can be expanded to an Individualized crawler easily or you can use the default crawl components only.
edyoda/data-science-complete-tutorial
For extensive instructor led learning
apptension/saas-boilerplate
SaaS Boilerplate - Open Source and free SaaS stack that lets you build SaaS products faster in React, Django and AWS. Focus on essential business logic instead of coding repeatable features!