/genie

Federated Big Data Orchestration Service

Primary LanguageJavaApache License 2.0Apache-2.0

Genie

[Download] (https://bintray.com/netflixoss/maven/genie/_latestVersion) License Issues

In Active Development

This branch contains code in active development towards Genie 3.0. If you want to see what we're working on see the 3.0.0 Milestone.

Introduction

Genie is a federated job orchestration engine developed by Netflix. Genie provides REST-ful APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing many distributed processing cluster configurations and the commands and applications which run on them.

Builds

Genie builds are run on Travis CI here.

Branch Build Coverage
Master Build Status Coverage Status

Docker

Successful builds will also generate a docker image which is published to Docker Hub.

App Image

[App Image] (https://hub.docker.com/r/netflixoss/genie-app/)

This is the image for the Spring Boot all in one jar. You can use docker pull netflixoss/genie-app:{version} to test the one you want.

You can run via docker run -t --rm -p 8080:8080 netflixoss/genie-app:{version}

WAR Image

[WAR Image] (https://hub.docker.com/r/netflixoss/genie-war/)

This is the image that has Genie deployed as a WAR file within Tomcat. You can use docker pull netflixoss/genie-war:{version} to test the one you want.

You can run via docker run -t --rm -p 8080:8080 netflixoss/genie-war:{version}

Demo

Genie has demo instructions available for all 3.x.x releases. Please see the release you're interested in demoing on the releases page. Click on the release and then demo docs.

Note: As 3.0.0 isn't fully released yet this is a work in progress. See the 3.0.0-SNAPSHOT "release" for in progress example.

Documentation

See the official website to find documentation about Genie and specific documentation for various releases.