lukasz-raduj/bigscale

Materials for BigScale study group.

BigScale study group materials

Message brokers

kafka

AMQP - protocol implemented by RabittMQ, ActiveMQ, etc

[Intro to AMQP] https://www.digitalocean.com/community/tutorials/an-advanced-message-queuing-protocol-amqp-walkthrough
[AMQP vs. JMS] http://www.wmrichards.com/amqp.pdf

AMQP implementations

[RabbitMQ] https://www.rabbitmq.com/getstarted.html
[ActiveMQ] http://activemq.apache.org/
[ZeroMQ]

We took a normal TCP socket, injected it with a mix of radioactive isotopes stolen from a secret Soviet 
atomic research project, bombarded it with 1950-era cosmic rays, and put it into the hands of a 
drug-addled comic book author with a badly-disguised fetish for bulging muscles clad in spandex. 
Yes, ZeroMQ sockets are the world-saving superheroes of the networking world.

http://zguide.zeromq.org/page:all

Other technologies

[Redis!] http://redis.io/topics/pubsub
[KaaS - Kafka as a Service :)] http://docs.aws.amazon.com/kinesis/latest/dev/introduction.html

Dimensions of comparison

ordering guarantees
throughput
latency
HA (e.g. durability)
other

Distributed Databases

DynamoDB

[amazon paper] http://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf

Stream processing

future subject

Worthy materials:

[linkedin] [samza] [rdbms]
https://www.youtube.com/watch?v=fU9hR3kiOK0