This repository contains all benchmarks collected over the years by SYNTCOMP community. There are several kinds of benchmarks:
aiger: safety games encoded in the extended AIGER format,tlsf: LTL synthesis encoded in TLSF format,tlsf-fin: LTLf synthesis, that is LTL for finite words, encoded in extended TLSF formatparity: parity games encoded in the extended HOA format.
Their folders contain more descriptions.
To submit a new benchmark
- create a new issue
- attach an archive with your new benchmarks with a sensible name
- the archive should also contain
readme.mdorreadme.pdfdescribing the benchmarks, relevant papers, etc.
We will check if everything is ok, and then add to the repository. Alternatively, you can create a pull request with your benchmarks.
- year 2023: TLSF, TLSF-fin, parity
- year 2022: TLSF, parity
- year 2021: TLSF, parity synthesis and realizability
- year 2020: AIGER, TLSF, for parity, see the repository.
- year 2019: AIGER, TLSF
- for the years 2015-2018, see here
If you find bugs in benchmarks, please create an issue describing the problem.