/siddhi-runner-beam

Primary LanguageJavaApache License 2.0Apache-2.0

siddhi-runner-beam

siddhi-runner-beam is a java library that executes a pipeline from Apache Beam in Siddhi.

How to Use

  • Add the runner library as a maven dependancy along with other Beam dependancies.
     <dependency>
        <groupId>org.wso2.siddhi.runner.beam</groupId>
        <artifactId>siddhi-runner-beam</artifactId>
        <version>x.x.x</version>
     </dependency>
  • Set the runner of the pipeline as SiddhiRunner.
     //SiddhiPipelineOptions is defined
     SiddhiPipelineOptions options = PipelineOptionsFactory.as(SiddhiPipelineOptions.class);
     options.setRunner(SiddhiRunner.class);

Features

Below is the list of transforms that are currently supported.

  • ParDo
  • GroupByKey
  • FixedWindow
  • Flatten
  • Partition
  • TextIO