theclaymethod

theclaymethod's Stars

• spotify/luigi

  Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

  Language:Python17.7k4749952.4k

• deeplearning4j/deeplearning4j

  Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

  Language:Java13.6k7655.8k3.8k

• haifengl/smile

  Statistical Machine Intelligence & Learning Engine

  Language:Java6k2696101.1k

• mesos/chronos

  Fault tolerant job scheduler for Mesos which handles dependencies and ISO8601 based schedules

  Language:Scala4.4k288452529

• milessabin/shapeless

  Generic programming for Scala

  Language:Scala3.4k103411530

• getguesstimate/guesstimate-app

  Create Fermi Estimates and Perform Monte Carlo Estimates

  Language:TypeScript2.3k56396125

• sixpack/sixpack

  Sixpack is a language-agnostic a/b-testing framework

  Language:Python1.8k71195185

• sryza/aas

  Code to accompany Advanced Analytics with Spark from O'Reilly Media

  Language:Scala1.5k1461061k

• yahoo/egads

  A Java package to automatically detect anomalies in large scale time-series data

  Language:Java1.2k11336331

• datumbox/datumbox-framework

  Datumbox is an open-source Machine Learning framework written in Java which allows the rapid development of Machine Learning and Statistical applications.

  Language:Java1.1k13729282

• QubitProducts/bamboo

  HAProxy auto configuration and auto service discovery for Mesos Marathon

  Language:Go79472125214

• sequenceiq/docker-spark

  Language:Shell7656547283

• miguno/kafka-storm-starter

  [PROJECT IS NO LONGER MAINTAINED] Code examples that show to integrate Apache Kafka 0.8+ with Apache Storm 0.9+ and Apache Spark Streaming 1.1+, while using Apache Avro as the data serialization format.

  Language:Scala7259112330

• dibbhatt/kafka-spark-consumer

  High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper. No Data-loss. No dependency on HDFS and WAL. In-built PID rate controller. Support Message Handler . Offset Lag checker.

  Language:Java6327061318

• aws-samples/emr-bootstrap-actions

  This repository hold the Amazon Elastic MapReduce sample bootstrap actions

  Language:Shell6147791304

• everpeace/vagrant-mesos

  Spin up your Mesos Cluster with Vagrant! (VirtualBox and AWS)

  Language:Ruby4323257139

• analytically/hadoop-ansible

  Ansible playbook that installs a Hadoop cluster, with HBase, Hive, Presto for analytics, and Ganglia, Smokeping, Fluentd, Elasticsearch and Kibana for monitoring and centralized log indexing.

  Language:Shell4184713127

• miguno/wirbelsturm

  [PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

  Language:Shell330363772

• daynebatten/keras-wtte-rnn

  Demo Weibull Time-to-event Recurrent Neural Network in Keras

  Language:Python21913775

• intentmedia/mario

  Functional, Typesafe, Declarative Data Pipelines

  Language:Scala13990216

• nathanmarz/kafka-deploy

  Automated deploy for Kafka on AWS

  Language:Clojure1239030

• HHammond/kcbo

  A Bayesian testing framework written in Python.

  Language:Python95918

• eigengo/lift

  ...Do you even? Exercise in exercise analysis

  Language:C++91272522

• kifi/ReactiveLDA

  ReactiveLDA is a fast, lightweight implementation of the Latent Dirichlet Allocation (LDA) algorithm, using a parallel vanilla Gibbs sampling algorithm.

  Language:Scala6222112

• mesos/spark-ec2

  [NOTE: Repository has moved to github.com/amplab/spark-ec2]

  Language:Shell57230116

• theclaymethod/Foundry-vagrant-mesos-kafka-cluster

  A Vagrant/Ansible => Kafka, Mesos (w/ Marathon/Docker), ZK, Hadoop, and Spark. Service discovery via HAProxy and Bamboo.

  Language:Shell509310

• kanzure/docker-basenode

  Docker service discovery where applications in each container route traffic through localhost haproxy to connect to other services in the cluster. Don't hardcode IP addresses.

  Language:Python40421

• AlpineNow/SparkML2

  Language:Scala2117314

• kadel/Dockerfiles

  Dockerfiles

  Language:Python9283

• bobtfish/nerve-etcd

  Nerve registration container (etcd backend)

  Language:Shell6311