Meta: Collect statistics
Opened this issue · 0 comments
sgraf812 commented
Collect statistics about how well reduction works. Take inspiration in previous work, like
- https://www.cs.utah.edu/~regehr/papers/pldi12-preprint.pdf
- https://pp.ipd.kit.edu/uploads/publikationen/stroessner18bachelorarbeit.pdf
- https://pp.ipd.kit.edu/uploads/publikationen/pkrueger19bachelorarbeit.pdf
TODO: Add interesting metrics to consider here. Edit description to do so
- starting size, end size, reduction size
- duration
- number of tests per pass, number of successful tests per pass
- number of removed bytes per pass
- how many other passes were enabled by a pass
- problem: how to get the dependencies between passes