The following list of benchmarks were used to evaluate our repair system.

Each benchmark contains a “fixme” comment indicating the place and kind of error introduced:

• Compiler.desugar1
• Compiler.desugar2
• Compiler.desugar3
• Compiler.desugar4
• Compiler.desugar5
• Compiler.simplify1
• Compiler.simplify2
• Heap.merge1
• Heap.merge2
• Heap.merge3
• Heap.merge4
• Heap.merge5
• Heap.insert
• Heap.makeNode
• Heap.merge
• List.pad
• List.++
• List.ap
• List.replace
• List.count
• List.find1
• List.find2
• List.find3
• List.size
• List.sum
• List.delete
• List.drop
• PropLogic.nnf1
• PropLogic.nnf2
• PropLogic.nnf3
• PropLogic.nnf4
• PropLogic.nnf5
• Numerical.power
• Numerical.moddiv
• MergeSort.split
• MergeSort.merge1
• MergeSort.merge2
• MergeSort.merge3
• MergeSort.merge4

The version of Leon used to run all these benchmarks is publicly available on Github.