livy

There are 40 repositories under livy topic.

  • linkis

    Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

    Language:Java3.3k

  • sparkmagic

    Jupyter magics and kernels for working with remote Spark clusters

    Language:Python1.3k
  • goodreads_etl_pipeline

    goodreads_etl_pipeline

    An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

    Language:Python1.3k
  • sparklyr

    sparklyr

    R interface for Apache Spark

    Language:R956

  • incubator-livy

    Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

    Language:Scala891

  • spark-on-kubernetes-helm

    Spark on Kubernetes infrastructure Helm charts repo

    Language:Mustache199

  • lighter

    REST API for Apache Spark on K8S or YARN

    Language:Java92

  • airflow-spark-operator-plugin

    A plugin to Apache Airflow to allow you to run Spark Submit Commands as an Operator

    Language:Python75

  • spark-on-kubernetes-docker

    Spark on Kubernetes infrastructure Docker images repo

    Language:Shell37

  • Loan-Default-Prediction

    Loan Default Prediction using PySpark, with jobs scheduled by Apache Airflow and Integration with Spark using Apache Livy

    Language:Jupyter Notebook18

  • livy-manager

    Livy Manager - Web UI for Managing Apache Livy Sessions

    Language:Rust16

  • k8s-big-data-experiments

    Experiments produced during an end of studies project (ETS, H2018)

    Language:Java15

  • incubator-livy-website

    Mirror of Apache livy (Incubating)

    Language:HTML13

  • SparkSharp

    C# Livy client to submit Spark jobs to HDInsight and other Spark clusters

    Language:C#9

  • apache-livy-docker

    Apache Livy server for Docker

    Language:Dockerfile6
  • airflow-ditto

    airflow-ditto

    An airflow DAG transformation framework

    Language:Python5

  • airflow-hdinsight

    HDInsight provider for Airflow

    Language:Python5

  • docker-livy

    Experiment to get LIVY+ Apache Spark working on DC/OS + MESOS + Docker

    Language:Shell5

  • livy-go

    Apache Livy client for the Go programming language.

    Language:Go4

  • Movie_Recommendation_Application

    This is a web-based movie recommendation application written in Scala using Apache Spark and Livy.

    Language:Scala3

  • livy-rs

    Apache Livy REST API Client

    Language:Rust3

  • airflow_extended_aws_plugin

    An Airflow plugin which supply some AWS operators with extended feature over the build in Airflow's operators

    Language:Python3

  • knox_livy_testing

    This tests Apache Knox proxying to Apache Livy

    Language:Shell3

  • Livy-net

    .net wrapper for Livy

    Language:C#3

  • Data-Engineering-Tools

    Data Engineering Tools

    Language:Shell2

  • jupyterlab-livy-spark

    Jupyterlab with Spark 2.4.8 integrated with help of Livy and Sparkmagic

    Language:Dockerfile1

  • apache-livy

    Apache Livy is an open source REST interface for interacting with Apache Spark from anywhere.

    1

  • livy-api-go-client

    Go API client for Apache Livy | Work in progress

    Language:Go1

  • Azure-Spark-Livy-Application-Insights-External-Dependency

    Use Spark with Livy along with Application Insights. Learn to host your external dependencies in data lake.

    Language:Java1

  • Cryptocurrency-Data-Pipeline

    This project involved the integration of several cutting-edge technologies to ensure efficient data processing and management for Cryptocurrency analytics.

    Language:Shell

  • ETL-Pipeline

    An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

    Language:Python

  • python-livy

    Tool and library to interact with Apache Livy

    Language:Python

  • pennbook

    PennBook is a highly scalable implementation of the core functionalities of facebook.com. It uses a Node.js server, React.js for the frontend, and Hadoop libraries such Apache Spark along with AWS Elastic MapReduce for the Big Data functionalities.

  • docker-spark-livy-server

    A Livy server for submitting Spark applications, with PySpark pre-configured

    Language:Dockerfile

  • livy-server-docker

    Apache Livy dockerized

    Language:Shell

  • bigdata-docker-compose

    Hadoop, Hive, Spark, Zeppelin and Livy: all in one Docker-compose file.

    Language:Dockerfile