Which is the fastest?

This project aims to be a load benchmarking suite, no more, no less

Measuring response times (routing times) for each framework (middleware).

⚠️

Results are not production-ready yet

⚠️

Additional purposes :

Helping decide between languages, depending on use case
Learning languages, best practices, devops culture ...
Having fun ❤️

Requirements

Crystal as built-in tools are made in this language
Docker as frameworks are isolated into containers
wrk as benchmarking tool, >= 4.1.0
postgresql to store data, >= 10

ℹ️ you need wrk stable

git clone --branch 4.1.0 https://github.com/wg/wrk

⚠️ docker is used for development purpose, production results will be computed on DigitalOcean ⚠️

Usage

Install all dependencies

shards install

Build internal tools

shards build

Create and initialize the database

createdb -U postgres benchmark
psql -U postgres -d benchmark < .ci/dump.sql

Docker can be used to set up the database:

docker run -it --rm -d \
  -p 5432:5432 \
  -e POSTGRES_DB=benchmark \
  -e POSTGRES_HOST_AUTH_METHOD=trust \
  -v /tmp/pg-data:/var/lib/postgresql/data \
  --name pg postgres:12-alpine

Wait several seconds for the container to start, then inject the dump:

docker exec pg sh -c "echo \"$(cat .ci/dump.sql)\" | psql -U postgres -d benchmark"

After creating the database, export its URL:

export DATABASE_URL="postgresql://postgres@localhost/benchmark"

Make configuration

bin/make config

Build containers

jobs are either languages (example : crystal) or frameworks (example : router.cr)

bin/neph [job1] [job2] [job3] ...

Export all results readme

bin/db to_readme

Results

ℹ️ Updated on 2020-04-19 ℹ️

Benchmarking with wrk

Threads : 8
Timeout : 8
Duration : 15s (seconds)

ℹ️ Sorted by max req/s on concurrency 64 ℹ️

	Language	Framework	Speed (64)	Speed (256)	Speed (512)	Speed (1024)	Speed (2048)

How to contribute ?

In any way you want ...

Request a framework addition
Report a bug (on any implementation)
Suggest an idea
...

Any kind of idea is ❤️

Contributors

Taichiro Suzuki - Author | Maintainer
OvermindDL1 - Maintainer
Marwan Rabbâa - Maintainer