/movement

Parallel Dataflow System

Primary LanguageJavaApache License 2.0Apache-2.0

Movement: A system for moving data from an emitter to an output via an encoder.

emiter-encoder-output triples are organized in one or more concurrent pipelines.

A WorkChunkDriver driver drives the system forward, and an Output ID driver provides an id for every emittable written to the output.