This repository contains the code of a workload generator for an LSM tree. It follows the DSL specified for the systems project of CS265 (Spring 2017).
More information can be found here.
You need the GNU scientific library in order to use the generator (https://www.gnu.org/software/gsl/).
- Ubuntu Linux:
sudo apt-get install libgsl-dev - Fedora Linux:
dnf install gsl-devel - Mac OS X:
brew install gsl - Cygwin: install the gsl, gsl-devel packages
cd generator;
make clean; make;
or simply...
cc generator.c -o generator -lgsl -lgslcblas
You can now run the following to see all available options:
./generator --help
Query 1: Insert 100000 keys, perform 1000 gets and 10 range queries and 20 deletes. The amount of misses of gets should be approximately 30% (--gets-misses-ratio) and 20% of the queries should be repeated (--gets-skewness).
./generator --puts 100000 --gets 1000 --ranges 10 --deletes 20 --gets-misses-ratio 0.3 --gets-skewness 0.2 > workload.txt
Query 2: Same as above but store the data in external (.dat) binary files.
./generator --puts 100000 --gets 1000 --ranges 10 --deletes 20 --gets-misses-ratio 0.3 --gets-skewness 0.2 --external-puts > workload.txt
Query 3: Perform 100000 puts and issue 100 range queries (drawn from a gaussian distribution).
./generator --puts 100000 --ranges 100 --gaussian-ranges > workload.txt
Query 4: Perform 100000 puts and issue 100 range queries (drawn from a uniform distribution).
./generator --puts 100000 --ranges 100 --uniform-ranges > workload.txt
Note: You can always set the random number generator seed using --seed XXXX
You can execute a workload and see some basic statistics about it, using the evaluate.py python script.
You need to install the blist library.
Most platforms: pip install blist
Note: In Fedora Linux, you might need to install it using: dnf install python-blist.
Run as follows:
python evaluate.py workload.txt
Note: For extra options etc, please look inside the script.