Project to bring Kubeflow Pipelines and Tekton together. The work is being driven in accordance with this evolving design doc specifications. Since this will evolve from experimental towards a more mature solution, we are keeping it currently separate from Kubeflow Pipeline repo.
The Tekton Pipelines project provides Kubernetes-style resources for declaring CI/CD-style pipelines. Tekton introduces several new CRDs including Task, Pipeline, TaskRun, and PipelineRun. A PipelineRun represents a single running instance of a Pipeline and is responsible for creating a Pod for each of its Tasks and as many containers within each Pod as it has Steps. Please look for more details in Tekton repo.
The work will be split in phases. While the details of the phases are listed in the design doc, the current effort in this repository is focused on creating a Kubeflow Pipeline compiler for Tekton, which can take KFP DSL, and compile it to Tekton YAML. Details will be updated as we move into other phases, in concurrence with design decisions.
We are currently using Kubeflow Pipelines 0.5.0 and Tekton 0.11.3 for this project.
Getting started with KFP Tekton Compiler SDK
Available Features and Implementation Details
Compilation Tests Status Report
Samples being run end to end for verification