MgBench
A new analytical benchmark for machine-generated log data.
Data
- bench1: http://cs.brown.edu/people/acrotty/mgbench/bench1.tar.gz
- bench2: http://cs.brown.edu/people/acrotty/mgbench/bench2.tar.gz
- bench3: http://cs.brown.edu/people/acrotty/mgbench/bench3.tar.gz
Preliminary Results
All experiments were conducted on a r5.12xlarge EC2 instance (48 vCPU, 384 GiB memory). Times are reported in seconds.
Benchmark 1
| System |
Load |
Q1 |
Q2 |
Q3 |
Q4 |
Q5 |
Q6 |
| ClickHouse |
11.6 |
0.007 |
0.010 |
0.009 |
0.009 |
0.023 |
0.017 |
| CrateDB |
1088.347 |
0.013 |
0.011 |
0.023 |
0.015 |
1.387 |
0.337 |
| Druid |
472.177 |
0.042 |
N/A |
0.061 |
0.032 |
0.134 |
0.137 |
| Hyper |
29.735 |
0.003 |
0.003 |
0.006 |
0.003 |
0.009 |
0.010 |
| MonetDB |
52.989 |
0.016 |
0.005 |
0.031 |
0.009 |
0.020 |
0.069 |
| PostgreSQL |
133.738 |
0.879 |
0.766 |
0.958 |
0.868 |
1.198 |
2.574 |
| +Index Time |
145.596 |
0.876 |
0.765 |
0.958 |
1.292 |
1.202 |
2.575 |
| +Index All |
403.432 |
0.129 |
0.005 |
0.047 |
0.563 |
1.501 |
0.457 |
| SparkSQL |
14.812 |
0.106 |
0.081 |
0.213 |
0.109 |
0.259 |
0.282 |
| TimescaleDB |
201.411 |
0.346 |
0.394 |
0.722 |
0.382 |
1.597 |
3.519 |
| +Index All |
400.749 |
0.010 |
0.001 |
0.014 |
0.069 |
1.298 |
0.152 |
Benchmark 2
| System |
Load |
Q1 |
Q2 |
Q3 |
Q4 |
Q5 |
Q6 |
| ClickHouse |
14.7 |
0.004 |
0.025 |
0.084 |
0.031 |
0.217 |
0.312 |
| CrateDB |
N/A |
0.009 |
0.089 |
3.699 |
1.789 |
13.619 |
11.282 |
| Druid |
1064.712 |
0.047 |
0.627 |
N/A |
3.147 |
2.865 |
0.964 |
| Hyper |
26.628 |
0.006 |
0.007 |
0.034 |
0.023 |
0.208 |
0.129 |
| MonetDB |
45.443 |
0.018 |
0.045 |
3.228 |
0.149 |
0.502 |
0.584 |
| PostgreSQL |
145.774 |
1.123 |
1.866 |
2.019 |
2.044 |
54.801 |
17.835 |
| +Index Time |
213.160 |
0.287 |
0.174 |
1.124 |
2.042 |
53.386 |
17.835 |
| +Index All |
610.496 |
0.281 |
2.172 |
4.099 |
2.043 |
53.389 |
17.834 |
| SparkSQL |
16.936 |
0.449 |
0.249 |
3.264 |
0.511 |
0.974 |
1.078 |
| TimescaleDB |
304.632 |
0.086 |
0.131 |
3.015 |
1.494 |
47.364 |
17.454 |
| +Index All |
606.273 |
0.001 |
0.121 |
1.395 |
1.437 |
47.303 |
17.374 |
Benchmark 3
| System |
Load |
Q1 |
Q2 |
Q3 |
Q4 |
Q5 |
Q6 |
| ClickHouse |
14.5 |
0.004 |
N/A |
N/A |
0.012 |
0.034 |
0.543 |
| CrateDB |
|
|
|
|
|
|
|
| Druid |
1207.445 |
0.041 |
N/A |
N/A |
0.061 |
N/A |
7.176 |
| Hyper |
53.308 |
0.008 |
0.099 |
0.010 |
0.008 |
0.014 |
0.142 |
| MonetDB |
61.301 |
0.039 |
1.593 |
0.041 |
0.048 |
0.090 |
8.438 |
| PostgreSQL |
242.270 |
3.257 |
255.778 |
3.771 |
3.096 |
3.873 |
42.745 |
| +Index Time |
310.320 |
0.127 |
254.876 |
3.803 |
3.095 |
3.891 |
42.744 |
| +Index All |
824.136 |
0.049 |
255.661 |
0.466 |
3.080 |
1.301 |
45.186 |
| SparkSQL |
28.661 |
0.044 |
N/A |
0.511 |
0.141 |
1.563 |
2.055 |
| TimescaleDB |
597.893 |
0.048 |
245.692 |
0.848 |
1.405 |
6.719 |
12.809 |
| +Index All |
946.893 |
0.001 |
242.173 |
0.076 |
0.084 |
0.803 |
12.803 |