Master Build |
License |
Reactive Streams Muon Stack
What is a Muon Stack?
Muon is a set of libraries and services that let you build highly effective distributed systems that are message and event oriented.
Muon is structured as a set of libraries, known as muon-core
that give a set of infrastructure for building messaging systems. These are available in multiple languages and handle the concerns of discovery, transport, encoding and managing failures. On top of these, the exact messaging semantics that you want to express are built. These are built as a "stack", a set of channels, agents and finally a user facing API that you will use in your application code.
Muon has several such stacks, covering different scenarios and tasks, letting you communicate in various ways, highly distributed, cross platform and taking advantage of best of breed infrastructure and technologies.
What is Reactive Streams?
Reactive streams is a cross industry initiative to enable streaming systems to interoperate within the JVM.
It defines a set of Java interfaces that various streaming technologies can use to exchange data between each other in a standardised manner. These interfaces have become so successful that they have been adopted into the Java standard library as of Java 9.
Using this stack
This stack enables you to expose and consume reactive stream endpoints on a network. It takes the communication definition of the Reactive Streams interfaces and maps it into Muon messaging.
It provides a server stack that you can attach to an existing Publisher
and then consume it remotely using a compatible Subscriber
. As Muon is cross platform/ polyglot, it also allows you to consume and provide RS endpoints on platforms other than the JVM.
JVM
To use the stack in Java, first import Muon and the RS stack
build.gradle
repositories {
jcenter()
maven { url 'https://simplicityitself.artifactoryonline.com/simplicityitself/muon' }
maven { url 'https://simplicityitself.artifactoryonline.com/simplicityitself/muon-snapshot' }
}
dependencies {
compile "io.muoncore:muon-core:$muonVersion"
compile "io.muoncore:muon-transport-amqp:$muonVersion"
compile "io.muoncore:muon-discovery-amqp:$muonVersion"
compile "io.muoncore.protocol:stack-reactive-streams:0.0.1-SNAPSHOT"
}
Create a Reactive Stream server
This stack allows you to expose an existing RS Publisher
so that it can be subscribed to remotely, and exchange all the signals defined for Reactive Streams (including most importantly, the back pressure signals)
First then, you need to be able to obtain a Publisher. If you don’t have one already, use a FRP system of some kind to make one. Consider using Spring Reactor, Akka Streams or RxJava, amongst others.
Once you have a Publisher, you can use Muon to network it.
Publisher publisher = .. your publisher ..
Muon muon = .. create a muon ..;
ReactiveStreamServer rs = new ReactiveStreamServer(muon);
rs.publishSource(
"/mystream", (1)
PublisherLookup.PublisherType.HOT (2)
publisher);
-
The name of the stream on the network
-
Indicate whether is is a cold or hot stream.
This will now be available. You can check this using the Muon CLI.
muon stream stream://<your-service>/mystream --raw
You can also generate Publisher instances on demand, if you want to parameterise your streams before they are used
Publisher publisher = .. your publisher ..
Muon muon = .. create a muon ..;
ReactiveStreamServer rs = new ReactiveStreamServer(muon);
rs.publishGeneratedSource(
"/ticktock",
PublisherLookup.PublisherType.HOT,
reactiveStreamSubscriptionRequest -> { (1)
Publisher mypub = null; // (2)
return mypub;
});
-
Factory function to create a Publisher, with the parameters passed available.
-
Create or obtain a Publisher instance to satisfy the request.
Create a Reactive Stream client
Creating a client is just as simple. Firstly you need a Subscriber
that you can use. There are many implementations, or you can code it yourself.
Subscriber<StreamData> subscriber = .. your subscriber ..
Muon muon = .. create a muon ..;
ReactiveStreamClient rs = new ReactiveStreamClient(muon);
rs.subscribe(
new URI("stream://<your-service>/mystream"), (1)
subscriber);
-
The target endpoint to susbcribe to
Even if you use this stack purely between Java services, this extends the capability of Reactive Streams across the network, allowing you to stream data between JVM processes easily, and translate the back pressure signals easily.
Node.js
Currently, only the the RS client stack is implemented in JavaScript.
To use this, import Muon and the stack
npm install --save muon-core@next
npm install --save muon-stack-reactive-streams@next
Then, create a Muon instance and RS client
index.js
var Muon = require("muon-core")
var muonurl = process.env.MUON_URL || "amqp://muon:microservices@localhost"
var muon = Muon.create("hello-world-node", muonurl); (1)
require("muon-stack-reactive-streams").create(muon) (2)
muon.subscribe("stream://hello-world-jvm/ticktock",{}, (3)
function(data) {
console.dir("Data..." + JSON.stringify(data))
},
function(error) {
console.dir(error)
},
function() {
logger.warn("Stream Completed")
}
)
-
Create a new Muon instance, connecting to a local AMQP broker for discovery and transport
-
Add the reactive streams stack.
-
Use the added
susbcribe
method to subscribe to the given endpoint.
The above API maps the various RS signals onto javascript callback functions. It internally manages back pressure signalling.
Getting involved/ adding to this stack.
Additions and extensions to this stack are very welcome.
Particularly of interest are :-
-
Added language support
-
Adding the javascript server stack
-
Integrate with javascript FRP libraries.
License
All code is Copyright (c) Muon Core Ltd 2017.
Muon is Free Software, licensed under the terms of the LGPLv3 license as included in LICENSE
Muon has a commercial-friendly license allowing private forks and closed modifications of all projects, alongside enterprise support and extended support for enterprise technologies and patterns.
This will enable you to use Muon in any situation where your legal team will not accept a Free Software license.
Please see http://muoncore.io/pro/ for more detail. You can find the commercial license terms in COMM-LICENSE