/benchmarks

Web Frameworks Benchmarks, Fighting!

Primary LanguageJavaScript

Benchmarks

Framework Version
Express 4.16.2
Koa 2.3.0
Toa 3.0.8
Restify 6.2.3
Rill 6.0.2
Trek Engine 1.0.5

Frameworks' Battle! 🔥 💥

Target Machine:

MacBook Pro (Retina, 13-inch, Late 2012)
Processor 2.5 GHz Intel Core i5
Memory 8 GB 1600 MHz DDR3
Graphics Intel HD Graphics 4000 1536 MB

Node v6.5.0
wrk v4.0.2
autocannon v0.14.1

With wrk

With wrk

$ make battle

5 middleware

  5 middleware
------- express -------
Hello World
Running 10s test @ http://127.0.0.1:7001?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.42ms  514.30us  16.98ms   95.09%
    Req/Sec     2.50k   631.05    19.66k    98.88%
  199480 requests in 10.10s, 39.95MB read
Requests/sec:  19747.95
Transfer/sec:      3.95MB

  5 middleware
------- koa -------
Hello World
Running 10s test @ http://127.0.0.1:7002?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.34ms  409.84us  14.86ms   94.22%
    Req/Sec     2.58k   200.84     3.18k    89.96%
  207253 requests in 10.10s, 29.85MB read
Requests/sec:  20511.36
Transfer/sec:      2.95MB

  5 middleware
------- toa -------
Hello World
Running 10s test @ http://127.0.0.1:7003?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.73ms    1.05ms  13.78ms   90.42%
    Req/Sec     2.25k   178.18     3.93k    92.12%
  179812 requests in 10.03s, 29.32MB read
Requests/sec:  17918.69
Transfer/sec:      2.92MB

  5 middleware
------- trek -------
Hello World
Running 10s test @ http://127.0.0.1:7004?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.08ms  367.29us  13.90ms   97.34%
    Req/Sec     2.91k   182.40     3.72k    93.38%
  231746 requests in 10.01s, 33.37MB read
Requests/sec:  23155.56
Transfer/sec:      3.33MB

  5 middleware
------- restify -------
Hello World
Running 10s test @ http://127.0.0.1:7005?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.23ms  310.03us  10.43ms   92.21%
    Req/Sec     2.71k   188.22     3.60k    93.55%
  217522 requests in 10.10s, 30.29MB read
Requests/sec:  21530.05
Transfer/sec:      3.00MB

15 middleware

  15 middleware
------- express -------
Hello World
Running 10s test @ http://127.0.0.1:7001?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.42ms  462.52us  16.94ms   95.94%
    Req/Sec     2.50k   401.69    10.25k    96.76%
  199932 requests in 10.10s, 40.04MB read
Requests/sec:  19792.69
Transfer/sec:      3.96MB

  15 middleware
------- koa -------
Hello World
Running 10s test @ http://127.0.0.1:7002?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.31ms  394.59us  14.63ms   96.04%
    Req/Sec     2.62k   199.83     4.33k    94.41%
  209847 requests in 10.10s, 30.22MB read
Requests/sec:  20770.36
Transfer/sec:      2.99MB

  15 middleware
------- toa -------
Hello World
Running 10s test @ http://127.0.0.1:7003?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.06ms    1.06ms  18.57ms   88.36%
    Req/Sec     1.98k   169.31     3.61k    91.75%
  157891 requests in 10.04s, 25.75MB read
Requests/sec:  15726.66
Transfer/sec:      2.56MB

  15 middleware
------- trek -------
Hello World
Running 10s test @ http://127.0.0.1:7004?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.10ms  357.51us  13.23ms   96.56%
    Req/Sec     2.88k   187.22     3.89k    95.53%
  230700 requests in 10.10s, 33.22MB read
Requests/sec:  22831.76
Transfer/sec:      3.29MB

  15 middleware
------- restify -------
Hello World
Running 10s test @ http://127.0.0.1:7005?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.80ms  363.48us  13.69ms   95.13%
    Req/Sec     2.16k   141.27     2.61k    95.12%
  171783 requests in 10.01s, 23.92MB read
Requests/sec:  17160.01
Transfer/sec:      2.39MB

30 middleware

  30 middleware
------- express -------
Hello World
Running 10s test @ http://127.0.0.1:7001?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.60ms  473.86us  15.84ms   95.97%
    Req/Sec     2.33k   180.69     2.49k    93.88%
  185462 requests in 10.01s, 37.14MB read
Requests/sec:  18533.23
Transfer/sec:      3.71MB

  30 middleware
------- koa -------
Hello World
Running 10s test @ http://127.0.0.1:7002?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.36ms  415.33us  15.19ms   96.55%
    Req/Sec     2.56k   238.05     5.20k    96.52%
  204993 requests in 10.10s, 29.52MB read
Requests/sec:  20289.27
Transfer/sec:      2.92MB

  30 middleware
------- toa -------
Hello World
Running 10s test @ http://127.0.0.1:7003?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.71ms    1.07ms  17.52ms   83.19%
    Req/Sec     1.63k   138.70     2.18k    90.38%
  130023 requests in 10.03s, 21.20MB read
Requests/sec:  12958.03
Transfer/sec:      2.11MB

  30 middleware
------- trek -------
Hello World
Running 10s test @ http://127.0.0.1:7004?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.14ms  379.79us  15.69ms   97.47%
    Req/Sec     2.83k   206.90     4.70k    96.52%
  226978 requests in 10.10s, 32.69MB read
Requests/sec:  22464.60
Transfer/sec:      3.24MB

  30 middleware
------- restify -------
Hello World
Running 10s test @ http://127.0.0.1:7005?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.57ms  575.01us  16.15ms   96.38%
    Req/Sec     1.69k   403.85    12.66k    98.88%
  134775 requests in 10.10s, 18.77MB read
Requests/sec:  13344.20
Transfer/sec:      1.86MB

50 middleware

  50 middleware
------- express -------
Hello World
Running 10s test @ http://127.0.0.1:7001?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.80ms  505.61us  21.18ms   96.30%
    Req/Sec     2.16k   500.48    15.70k    98.88%
  172472 requests in 10.10s, 34.54MB read
Requests/sec:  17075.68
Transfer/sec:      3.42MB

  50 middleware
------- koa -------
Hello World
Running 10s test @ http://127.0.0.1:7002?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.38ms  400.03us  12.85ms   96.94%
    Req/Sec     2.54k   404.75    10.87k    98.75%
  202600 requests in 10.10s, 29.18MB read
Requests/sec:  20053.24
Transfer/sec:      2.89MB

  50 middleware
------- toa -------
Hello World
Running 10s test @ http://127.0.0.1:7003?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.56ms    1.16ms  21.00ms   78.64%
    Req/Sec     1.33k   121.92     1.53k    87.50%
  105908 requests in 10.04s, 17.27MB read
Requests/sec:  10543.60
Transfer/sec:      1.72MB

  50 middleware
------- trek -------
Hello World
Running 10s test @ http://127.0.0.1:7004?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.20ms  378.50us  14.75ms   98.19%
    Req/Sec     2.75k   154.34     2.85k    97.77%
  221114 requests in 10.10s, 31.84MB read
Requests/sec:  21883.21
Transfer/sec:      3.15MB

  50 middleware
------- restify -------
Hello World
Running 10s test @ http://127.0.0.1:7005?foo[bar]=baz
  8 threads and 50 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     5.23ms  645.13us  23.60ms   97.64%
    Req/Sec     1.15k    78.76     1.22k    97.38%
  91980 requests in 10.01s, 12.81MB read
Requests/sec:   9187.29
Transfer/sec:      1.28MB

With autocannon

$ benchmarker=autocannon make battle

5 middleware

  5 middleware
------- express -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 2.07     0.39      18
Req/Sec      18842.91 623.23    19151
Bytes/Sec    3.95 MB  115.53 kB 4.06 MB

207k requests in 11s, 43.52 MB read

  5 middleware
------- koa -------
Hello World
Stat         Avg      Stdev    Max
Latency (ms) 2.01     0.3      18
Req/Sec      22831.28 556.08   23135
Bytes/Sec    3.45 MB  75.36 kB 3.54 MB

251k requests in 11s, 37.92 MB read

  5 middleware
------- toa -------
Hello World
Stat         Avg    Stdev     Max
Latency (ms) 2.16   1.47      16
Req/Sec      18760  683.78    19199
Bytes/Sec    3.2 MB 130.53 kB 3.41 MB

206k requests in 11s, 35.29 MB read

  5 middleware
------- trek -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 1.11     0.39      19
Req/Sec      26698.91 620.84    26991
Bytes/Sec    4.03 MB  113.04 kB 4.19 MB

294k requests in 11s, 44.35 MB read

  5 middleware
------- restify -------
Hello World
Stat         Avg     Stdev     Max
Latency (ms) 2.01    0.27      16
Req/Sec      22629.1 660.08    22927
Bytes/Sec    3.31 MB 113.04 kB 3.41 MB

249k requests in 11s, 36.34 MB read

15 middleware

  15 middleware
------- express -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 2.12     0.45      19
Req/Sec      18254.91 675.08    18559
Bytes/Sec    3.81 MB  151.66 kB 3.93 MB

201k requests in 11s, 42.17 MB read

  15 middleware
------- koa -------
Hello World
Stat         Avg      Stdev    Max
Latency (ms) 2        0.29     16
Req/Sec      22762.91 590.92   23023
Bytes/Sec    3.45 MB  75.36 kB 3.54 MB

250k requests in 11s, 37.81 MB read

  15 middleware
------- toa -------
Hello World
Stat         Avg     Stdev     Max
Latency (ms) 2.51    1.54      19
Req/Sec      16000.8 598.88    16303
Bytes/Sec    2.78 MB 117.96 kB 2.88 MB

160k requests in 10s, 27.36 MB read

  15 middleware
------- trek -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 1.18     0.45      17
Req/Sec      25836.37 551.95    26111
Bytes/Sec    3.88 MB  103.88 kB 4.06 MB

284k requests in 11s, 42.91 MB read

  15 middleware
------- restify -------
Hello World
Stat         Avg     Stdev    Max
Latency (ms) 2.15    0.48     18
Req/Sec      17210   512.13   17439
Bytes/Sec    2.53 MB 78.64 kB 2.62 MB

172k requests in 10s, 25.13 MB read

30 middleware

  30 middleware
------- express -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 2.29     0.57      19
Req/Sec      16643.28 612.51    16911
Bytes/Sec    3.52 MB  150.72 kB 3.67 MB

183k requests in 11s, 38.44 MB read

  30 middleware
------- koa -------
Hello World
Stat         Avg     Stdev    Max
Latency (ms) 2.01    0.28     16
Req/Sec      22037.1 561.76   22319
Bytes/Sec    3.32 MB 75.36 kB 3.41 MB

242k requests in 11s, 36.6 MB read

  30 middleware
------- toa -------
Hello World
Stat         Avg     Stdev    Max
Latency (ms) 3.45    1.51     19
Req/Sec      13137.6 431.65   13423
Bytes/Sec    2.26 MB 88.47 kB 2.36 MB

131k requests in 10s, 22.46 MB read

  30 middleware
------- trek -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 1.34     0.54      15


Req/Sec      25043.64 594.07    25343
Bytes/Sec    3.82 MB  115.53 kB 3.93 MB

275k requests in 11s, 41.6 MB read

  30 middleware
------- restify -------
Hello World
Stat         Avg      Stdev    Max
Latency (ms) 3.15     0.58     23
Req/Sec      13585.82 489.39   13783
Bytes/Sec    1.98 MB  75.36 kB 2.03 MB

149k requests in 11s, 21.82 MB read

50 middleware

  50 middleware
------- express -------
Hello World
Stat         Avg      Stdev     Max
Latency (ms) 2.94     0.47      22
Req/Sec      15840.37 625.41    16127
Bytes/Sec    3.31 MB  113.04 kB 3.41 MB

174k requests in 11s, 36.59 MB read

  50 middleware
------- koa -------
Hello World
Stat         Avg     Stdev     Max
Latency (ms) 2.01    0.29      17
Req/Sec      21928   697.8     22351
Bytes/Sec    3.29 MB 115.53 kB 3.41 MB

241k requests in 11s, 36.42 MB read

  50 middleware
------- toa -------
Hello World
Stat         Avg     Stdev    Max
Latency (ms) 4.19    2.04     25
Req/Sec      10713.6 382.99   11071
Bytes/Sec    1.83 MB 66.83 kB 1.9 MB

107k requests in 10s, 18.32 MB read

  50 middleware
------- trek -------
Hello World
Stat         Avg      Stdev    Max
Latency (ms) 1.57     0.56     17
Req/Sec      24493.82 585      24767
Bytes/Sec    3.71 MB  75.36 kB 3.8 MB

269k requests in 11s, 40.68 MB read

  50 middleware
------- restify -------
Hello World
Stat         Avg     Stdev     Max
Latency (ms) 5.07    1.1       25
Req/Sec      9103.21 691.03    9559
Bytes/Sec    1.32 MB 109.86 kB 1.44 MB

91k requests in 10s, 13.29 MB read