scredis

Scredis is a reactive, non-blocking and ultra-fast Scala Redis client built on top of Akka IO. It has been (and still is) extensively used in production at Livestream.

Features

Supports all Redis commands up to v3.0.0
Built on top of Akka non-blocking IO
Super fast, see Benchmarks section below
Automatic reconnection
Automatic pipelining
Transactions
Pub/Sub
- Subscribe selectively with partial functions
- Tracked Subscribe and Unsubscribe commands (they return a Future as any other commands)
- Automatically resubscribes to previously subscribed channels/patterns upon reconnection
Cluster support via RedisCluster
Customizable serialization and deserialization of command inputs and outputs
Fully configurable
- Akka dispatchers
- Pipelined write batch size
- Receive timeout
- TCP buffer size hints
- Request encoding buffer pool
- Concurrent requests cap (bounded memory consumption)

Getting started

Binaries

Scredis 2.1.7+ is compatible with Scala 2.11 and 2.12. Binary releases are hosted on the Sonatype Central Repository.

libraryDependencies += "com.github.scredis" %% "scredis" % "2.2.4"

Snapshots / development versions are hosted on a separate bintray repository.

resolvers += Resolver.bintrayRepo("scredis","maven")

libraryDependencies += "com.github.scredis" %% "scredis" % "<version>"

Quick example

import scredis._
import scala.util.{ Success, Failure }

// Creates a Redis instance with default configuration.
// See reference.conf for the complete list of configurable parameters.
val redis = Redis()

// Import internal ActorSystem's dispatcher (execution context) to register callbacks
import redis.dispatcher

// Executing a non-blocking command and registering callbacks on the returned Future
redis.hGetAll("my-hash") onComplete {
  case Success(content) => println(content)
  case Failure(e) => e.printStackTrace()
}

// Executes a blocking command using the internal, lazily initialized BlockingClient
redis.blocking.blPop(0, "queue")

// Subscribes to a Pub/Sub channel using the internal, lazily initialized SubscriberClient
redis.subscriber.subscribe("My Channel") {
  case message @ PubSubMessage.Message(channel, messageBytes) => println(
    message.readAs[String]()
  )
  case PubSubMessage.Subscribe(channel, subscribedChannelsCount) => println(
    s"Successfully subscribed to $channel"
  )
}

// Shutdown all initialized internal clients along with the ActorSystem
redis.quit()

Benchmarks

The following benchmarks have been performed using ScalaMeter with the SeparateJvmsExecutor, configured with Warmer.Default, Measurer.Default and Aggregator.average. The source code can be found here.

Hardware

MacBook Pro (15-inch, Early 2011)
2.0GHz quad-core Intel Core i7 processor with 6MB shared L3 cache
16GB of 1333MHz DDR3 memory
Mac OS X 10.9.4

Java

> java -version
java version "1.7.0_45"
Java(TM) SE Runtime Environment (build 1.7.0_45-b18)
Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)

Scala

Scala 2.11.2

Scredis

2.0.0-RC1 with default configuration

Redis

Redis 2.8.13 running locally (on the same machine)

Developing

Running the tests

The tests require two Redis instances to be running with some specific configuration options set. They can be started with the start-redis-test-instances.sh script. Stopping is done with script stop-redis.sh

Some tests require redis-cluster, redis-cluster can be started with run-redis-cluster.sh. 6 redis instances will be started on ports 7000-7005 without authorization.

Results

[info] :::Summary of regression test results - Accepter():::
[info] Test group: Client.PING
[info] - Client.PING.Test-0 measurements:
[info]   - at size -> 1000000: passed
[info]     (mean = 1496.30 ms, ci = <1396.51 ms, 1596.10 ms>, significance = 1.0E-10)
[info]   - at size -> 2000000: passed
[info]     (mean = 3106.07 ms, ci = <2849.27 ms, 3362.87 ms>, significance = 1.0E-10)
[info]   - at size -> 3000000: passed
[info]     (mean = 4735.93 ms, ci = <4494.92 ms, 4976.94 ms>, significance = 1.0E-10)
[info]
[info] Test group: Client.GET
[info] - Client.GET.Test-1 measurements:
[info]   - at size -> 1000000: passed
[info]     (mean = 2452.47 ms, ci = <2308.81 ms, 2596.12 ms>, significance = 1.0E-10)
[info]   - at size -> 2000000: passed
[info]     (mean = 4880.42 ms, ci = <4629.75 ms, 5131.09 ms>, significance = 1.0E-10)
[info]   - at size -> 3000000: passed
[info]     (mean = 7271.20 ms, ci = <6795.45 ms, 7746.94 ms>, significance = 1.0E-10)
[info]
[info] Test group: Client.SET
[info] - Client.SET.Test-2 measurements:
[info]   - at size -> 1000000: passed
[info]     (mean = 2969.00 ms, ci = <2768.45 ms, 3169.54 ms>, significance = 1.0E-10)
[info]   - at size -> 2000000: passed
[info]     (mean = 5912.59 ms, ci = <5665.94 ms, 6159.24 ms>, significance = 1.0E-10)
[info]   - at size -> 3000000: passed
[info]     (mean = 8752.69 ms, ci = <8403.07 ms, 9102.31 ms>, significance = 1.0E-10)
[info]
[info]  Summary: 3 tests passed, 0 tests failed.

Ping

1,000,000 requests -> 1496.30 ms = 668,315 req/s
2,000,000 requests -> 3106.07 ms = 643,900 req/s
3,000,000 requests -> 4735.93 ms = 633,455 req/s

Get

1,000,000 requests -> 2452.47 ms = 407,752 req/s
2,000,000 requests -> 4880.42 ms = 409,801 req/s
3,000,000 requests -> 7271.20 ms = 412,587 req/s

Set

1,000,000 requests -> 2969.00 ms = 336,814 req/s
2,000,000 requests -> 5912.59 ms = 338,261 req/s
3,000,000 requests -> 8752.69 ms = 342,752 req/s

Releasing

Scredis uses sbt-dynver plugin to automatically manage versioning.

Releases are only performed from a master branch.

If current commit on master branch is not tagged then a previous tag is used as base version with added current date (snapshot version).

If current commit on master is tagged then a version is the same as tag and this version is stable.

Build on travis checks what is current branch and if it is master it executes publish step.

Publish step uses sbt plugin sbt-bintray to publish artifacts to bintray repository.

Bintray repository https://bintray.com/scredis/maven/scredis.

Released version is automatically populated to jcenter bintray https://search.maven.org/search?q=g:com.github.scredis

Manual step is needed to populate to mvnrepository

Maintainer performing stable release should:

switch to master branch and update README with tag X.Y.Z and commit changes.
git tag -a "vX.Y.Z" -m "Release version vX.Y.Z" # tag current commit with given tag
git push origin vX.Y.Z # tags are not automatically pushed by git push
go to bintray and click 'Sync' to push released version to mvnrepository.

License

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License.

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. See accompanying LICENSE file.

nicolasdalsass/scredis