- a masterless, cloud scale, fault tolerant, high performance distributed computation system
- batch and stream hybrid processing model
- exposes an information model for the description and construction of distributed workflows
- Competes against Storm, Cascading, Cascalog, Spark, Map/Reduce, Sqoop, etc
- written in pure Clojure
- Realtime event stream processing
- Continuous computation
- Extract, transform, load
- Data transformation à la map-reduce
- Data ingestion and storage medium transfer
- Data cleaning
Available on Clojars:
[org.onyxplatform/onyx "0.9.11"]
Component | release |
unstable |
compatibility |
---|---|---|---|
onyx core | - |
||
onyx-kafka | |||
onyx-kafka-0.8 | |||
onyx-datomic | |||
onyx-redis | |||
onyx-sql | |||
onyx-bookkeeper | |||
onyx-seq | |||
onyx-durable-queue | |||
onyx-elasticsearch | |||
onyx-amazon-sqs | |||
onyx-amazon-s3 | |||
onyx-http | |||
learn-onyx | - |
||
onyx-examples | |||
onyx-dashboard | |||
onyx-metrics | |||
onyx-peer-http-query |
release
: stable, released contentunstable
: unreleased contentcompatibility
: edge, unstable, unreleased content depending on coremaster
<img src="doc/images/cognician.png" height"30%" width="30%">
<img src="doc/images/indaba.png" height"40%" width="40%">
Feeling impatient? Hit the ground running ASAP with the onyx-starter repo and walkthrough. You can also boot into preloaded a Leiningen application template.
Code level API documentation can be found here.
Official plugins are vetted by Michael Drogalis. Ensure in your project that plugin versions directly correspond to the same Onyx version (e.g. onyx-core-async
version 0.9.11.0-SNAPSHOT
goes with onyx
version 0.9.11
). Fixes to plugins can be applied using a 4th versioning identifier (e.g. 0.9.11.1-SNAPSHOT
).
onyx-core-async
onyx-kafka
onyx-kafka-0.8
onyx-datomic
onyx-redis
onyx-sql
onyx-bookkeeper
onyx-seq
onyx-durable-queue
onyx-elasticsearch
onyx-http
onyx-amazon-sqs
onyx-amazon-s3
Generate plugin templates through Leiningen with onyx-plugin
.
Unofficial plugins have not been vetted.
You can run a dashboard to monitor Onyx cluster activity, found here. Further, you can collect metrics and send them to the dashboard, or anywhere, by using the onyx-metrics plugin.
Check out the Onyx Google Group.
Feel free to use it anywhere. You can find a few different versions here.
A simple lein test
will run the full suite for Onyx core.
- Michael Drogalis
- Lucas Bradstreet
- Owen Jones
- Bruce Durling
- Malcolm Sparks
- Bryce Blanton
- David Rupp
- sbennett33
- Tyler van Hensbergen
- David Leatherman
- Daniel Compton
- Jeff Rose
- Ole Krüger
- Juho Teperi
- Nicolas Ha
- Andrew Meredith
- Bridget Hillyer
- Ivan Mushketyk
- Jochen Rau
- Tienson Qin
- Roman Volosovskyi
- Vijay Kiran
- Paul Kehrer
- Scott Bennett
- Nathan Todd.stone
- Mariusz Jachimowicz
Some code has been incorporated from the following projects:
- [Riemann] (https://github.com/aphyr/riemann)
- [zookeeper-clj] (https://github.com/liebke/zookeeper-clj)
Copyright © 2015 Michael Drogalis
Distributed under the Eclipse Public License, the same as Clojure.
YourKit supports open source projects with its full-featured Java Profiler. YourKit, LLC is the creator of YourKit Java Profiler and YourKit .NET Profiler, innovative and intelligent tools for profiling Java and .NET applications.