Pongo

A not-serious command line benchmarking tool for NoSQL datastores

This is just an exercise in learning about new NoSQL datastores and understanding the shortcomings of intra-DB benchmarks

Setup

$ git clone https://github.com/cblanc/pongo_benchmark

$ npm link

Example

$ pongo -t insert -s mongodb

Current Stores

Postgresql
MongoDB
Redis

Setting the flag:

-s mongodb

Current Test Methods

Insert

Setting the flag:

-t insert

Notes

The following steps have been taken to reduce (as much as possbile) the confounding effects of javascript runtime (like JSON parsing/stringifying) or quirks of the database driver

Database instructions are buffered in memory as much as possible prior to benchmarking
Database instructions are sent in series
Custom connection pooling (only single client is instantiated and used in series)
No ORMS, just a single client instance communicating with the database

Why intra-DB tests are silly

Tests are highly subject to DB drivers and libraries built on top. E.g. When implementing MongoDB tests, time for insert was halved by reusing the same client repeatedly