lambdacd-value-stream

A library that adds upstream and downstream triggers to LambdaCD

Status

When to use this

When you want to split your pipeline up into multiple, smaller pipelines and trigger one pipeline from another.

Usage

Initialization (version >= 0.2.0)

(let [foo-config {; ...
                  :value-stream {:pipeline-id :foo}}
      foo-config {; ...
                  :value-stream {:pipeline-id :bar}}
      foo-pipeline (lambdacd/assemble-pipeline foo-structure foo-config)
      bar-pipeline (lambdacd/assemble-pipeline bar-structure bar-config)]
    ; ...
    (value-stream/initialize-value-stream [foo-pipeline bar-pipeline]
    ; ...
    )

Initialization (version < 0.2.0)

(let [foo-pipeline (lambdacd/assemble-pipeline foo-structure foo-config)
      bar-pipeline (lambdacd/assemble-pipeline bar-structure bar-config)]
    ; ...
    (value-stream/initialize-value-stream {:foo foo-pipeline
                                           :bar bar-pipeline})
    ; ...
    )

Wait for upstream pipeline to complete

(defn wait-for-foo-pipeline [args ctx]
  (value-stream/wait-for-pipline-success :foo ctx))

Wait for trigger from upstream pipeline (version >= 0.2.0)

(defn wait-for-upstream-trigger [args ctx]
  ; you can also inline this into the pipeline-structure
  (value-stream/wait-for-upstream-trigger args ctx))

Trigger downstream pipeline (version >= 0.2.0)

(defn trigger-bar-pipeline [args ctx]
  (value-stream/trigger-downstream-pipeline :bar args ctx))

See example for a complete example.

Features

Wait for upstream success
Trigger from upstream step
Visualization

License

Distributed under the Apache License 2.0

flosell/lambdacd-value-stream