state-of-the-art-bug-benchmarks

Benchmark Publication Year Link to paper Link to benchmark
Siemens 1994 pdf
SIR 2005 pdf
BugBench 2005 pdf
iBugs 2007 pdf-short, pdf-full
FaultBench 2008 pdf
BegBunch 2009 pdf
RADBench 2011 pdf
Defects4J 2014 pdf
CoREBench 2014 pdf
ManyBugs 2015 pdf
IntroClass 2015 pdf
JaConTeBe 2015 pdf
IntroClassJava 2016 pdf
MUBench 2016 pdf
DroidLeaks 2016 pdf
Codeflaws 2017 pdf
QuixBugs 2017 pdf
Bugs.jar 2018