/pipeline

Real-time, End-to-End, Advanced Analytics and Machine Learning Recommendation Pipeline

Primary LanguageJupyter NotebookOtherNOASSERTION

##PANCAKE STACK

End-to-End Streaming Advanced Analytics and Machine Learning Recommendation Pipeline

Follow Wiki to Setup Docker-based Environment

PANCAKE STACK

Architecture Overview

Pipeline Architecture Overview

Screenshots

Apache Zeppelin Notebooks

Apache Zeppelin Notebooks

Stanford CoreNLP Sentiment Analysis

Stanford CoreNLP Sentiment

Jupyter/iPython Notebooks

Jupyter/iPython Notebooks

SparkR Notebooks

SparkR Notebooks

TensorFlow Notebooks

TensorFlow Notebooks

Apache NiFi Data Flows

Apache NiFi Data Flows

AirFlow Workflows

AirFlow Workflows

Presto Queries

Presto Queries

Tableau Integration

Tableau Integration

Beeline Command-line Hive Client

Beeline Command-line Hive Client

Log Visualization with Kibana & Logstash

Log Visualization with Kibana & Logstash

Spark, Spark Streaming, and Spark SQL Admin UIs

Spark Admin UI Spark Admin UI Spark Admin UI Spark Admin UI Spark Admin UI Spark Admin UI

Ganglia System and JVM Metrics Monitoring UIs

Ganglia Metrics UI Ganglia Metrics UI Ganglia Metrics UI

Tools Overview

Apache Spark Redis Apache Cassandra Apache Kafka NiFi ElasticSearch Logstash Kibana Apache Zeppelin Ganglia Hadoop HDFS iPython Notebook Docker Tachyon