/livy-server-docker

Apache Livy dockerized

Primary LanguageShellApache License 2.0Apache-2.0

Apache Livy Docker Container

Based on the latest release of the Apache Livy project

Supported Versions:

To see which images are available see the build matrix.

Configuration

Required environment variables:

  • SPARK_MASTER => Spark Master IP
  • DEPLOY_MODE => client or cluster

Per default the /tmp folder is configured as path for submitting local files via Livy Server. It is configurable through LOCAL_DIR_WHITELIST environment variable.

Usage:

docker run -p 8998:8998 -e SPARK_MASTER="local[*]" -e DEPLOY_MODE=client davlum/livy:0.7.0-spark2.4.4

Visit http://localhost:8998