mring33621/FlinkNifiDemo

Setup instructions for my recent Flink-NiFi demo.

FlinkNifiDemo

Setup instructions for my recent Flink-NiFi demo.

Refer to the Demo Slides

1. Install Java 8
2. Install a NATS Messaging server
3. Install [Apache NiFi] (https://nifi.apache.org/download.html)
4. Clone and install the following Maven projects:

• https://github.com/mring33621/scripting-for-nifi
• https://github.com/mring33621/nats-messaging-for-nifi
• https://github.com/mring33621/nats-messaging-for-flink
• https://github.com/mring33621/MarketData
• https://github.com/mring33621/StockMarketTicker
• https://github.com/mring33621/StreamVisServer
• https://github.com/mring33621/DemoFlinkEngines

5. Copy the following .nar files into NiFi/lib

• nifi-scripting-nar-x.y.z.nar
• nifi-nats-nar-x.y.z.nar

6. Run the gnatsd server
7. Run NiFi then import the FlinkNifiDemoFlow.xml file
8. Unzip var.zip into your /var dir (be careful, back up anything already there before you unzip my stuff)
9. Run DemoFlinkEngines com.mattring.demoflinkengines.EnginesMain
10. Run StreamVisServer com.mattring.streamvisserver.ServerMain
11. Point your browser to http://localhost:4567/DemoPages/dashboard.html to watch the fun

Notes:

1. This is a DEMO. Most of the code is of the random, pretend-to-work type.
2. There are several hard-coded expectations:

• Everything in the /var path (see step 8, above)
• NATS server at localhost:4222