Synthesis within CVC4
Counterexample Guided Quantifier Instantiation for Synthesis in SMT
We provide the following supplementary material for this paper.
Solver
The zip archive containing the binary of CVC4 used in our experiments can be found here: cvc4-sygus.zip
- Configuration cvc4+sg from the paper is enabled by command line parameters “–cegqi –dump-synth”.
- Configuration cvc4+si-r is enabled by “–cegqi-si –dump-synth –no-cegqi-si-reconstruct”
- Configuration cvc4+si is enabled by “–cegqi-si –dump-synth”
Results
The spreadsheet summarizing the results for the benchmarks considered in this paper can be accessed here: results-cav2015-synth.xls.
Our evaluation used the StarExec cluster for evaluation https://www.starexec.org. The jobs we ran in our evaluation are publicly available, and can be accessed by logging into StarExec as a guest (click “Guest” at the bottom of the log in page). The links to the individual jobs are:
For ESolver:
https://www.starexec.org/starexec/secure/details/job.jsp?id=6440.
For all three configurations of CVC4:
https://www.starexec.org/starexec/secure/details/job.jsp?id=6561
Refutation-Based Synthesis in SMT
We provide the following supplementary material for this paper.
Solver
The zip archive containing the binary of CVC4 used in our experiments can be found here: cvc4-sygus.zip
- Configuration cvc4+sg from the paper is enabled by command line parameters “–cegqi –dump-synth”.
- Configuration cvc4+si-r is enabled by “–cegqi-si –dump-synth –no-cegqi-si-reconstruct”
- Configuration cvc4+si is enabled by “–cegqi-si –dump-synth”
Results
The spreadsheet summarizing the results for the benchmarks considered in this paper can be accessed here. For benchmarks with syntactic restrictions (Fig 9 and Fig 11): results-general-fmsd.xls. For the max family of benchmarks (Fig 10): results-max-fmsd.xls. For benchmarks without syntactic restrictions (Fig 12): results-clia-fmsd.xls.
Our evaluation used the StarExec cluster for evaluation https://www.starexec.org. The jobs we ran in our evaluation are publicly available, and can be accessed by logging into StarExec as a guest (click “Guest” at the bottom of the log in page). The links to the individual jobs are below, which include additional configurations not mention in this paper.
For all solvers, except the latest version of CVC4, on benchmarks with syntactic restrictions:
https://www.starexec.org/starexec/secure/details/job.jsp?id=10526
For all configurations of CVC4 on benchmarks with syntactic restrictions:
https://www.starexec.org/starexec/secure/details/job.jsp?id=10575
For all solvers on the max family of benchmarks:
https://www.starexec.org/starexec/secure/details/job.jsp?id=11076
For all solvers, except the latest version of CVC4, on benchmarks without syntactic restrictions:
https://www.starexec.org/starexec/secure/details/job.jsp?id=10556
For CVC4 on benchmarks without syntactic restrictions:
https://www.starexec.org/starexec/secure/details/job.jsp?id=10597