irfanj/genie

Federated Job Execution Engine

Genie

[] (https://bintray.com/netflixoss/maven/genie/_latestVersion)

In Active Development

This branch contains code in active development towards Genie 3.0. It is not yet ready for use. If you're looking for a version that is ready for production please see the master branch. If you want to see what we're working on see the 3.0.0 Milestone.

Introduction

Genie is a federated job execution engine developed by Netflix. Genie provides REST-ful APIs to run a variety of big data jobs like Hadoop, Pig, Hive, Spark, Presto, Sqoop and more. It also provides APIs for managing many distributed processing cluster configurations and the commands and applications which run on them.

Builds

Genie builds are run on Travis CI here.

Branch	Build	Coverage
Master
Develop

Documentation

• Netflix Tech Blog Posts
  • Genie 1
  • Genie 2
  • All Posts from the Big Data Team at Netflix
• Presentations
  • Netflix OSS Meetups
    • Season 3 Episode 1
      • Slides
      • YouTube
  • 2013 Hadoop Summit
• Genie Github
  • Wiki
  • Source
• Client API Documentation
  • REST
  • Python
  • Java

Example

Please see the ZeroToDocker project for [instructions] (https://github.com/Netflix-Skunkworks/zerotodocker/wiki/Genie) of an end to end example in [Docker] (https://www.docker.com/).

Support

Please use the Google Group for general questions and discussion.

Issues

You can request bug fixes and new features here.