Open up a pull request on this repository to add a benchmark to the
benchmarks/
directory.
Here's how to get started running benchmarks for the final homework:
- Clone this respository into your final homework repository:
git clone https://github.com/BrownCS1260/final-benchmarks.git benchmarks
- In the new benchmarks directory, make a
config.json
file. This file should be a JSON-formatted dictionary where the keys are configurations and the values are lists of pass names. For example, it might look like:
{"No optimizations": [],
"Inlining": ["uniquify-variables", "inline"],
"Constant propagation and inlining": ["uniquify-variables", "inline", "propagate-constants"]}
- Run the benchmark script. It will run each benchmark 10 times using each
specified configuration and write the results to
results.csv
.
python3 bench.py
Have fun!