spark-monitor

lightweight daemon for monitoring and notification about spark problems

Build (optionally, needed to update ca-certificates)

./build.sh 0.1.1

Run

docker run -e "APP_COUNT=3" \
           -e "DRIVER_ADDRESS=spark:4040" \
           -e "PERIOD=60" \
           -e "MESSAGE_PREFIX=Application1" \
           -e "PUBLISHER_ADDRESS=slack-publisher:8000" \
           -d -p cortwave/spark-monitor:0.1.1

DRIVER_ADDRESS - address (host + port) of running spark driver
APP_COUNT - apss count which should be run on spark driver
PERIOD - period in sec to check spark state
MESSAGE_PREFIX - prefix for all notifications (appname e.g.)
PUBLISHER_ADDRESS - address of running publisher slack-publisher e.g.)