SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

Participants
Results

QF_Strings (QF_S, QF_SLIA) - Single Query Track

Competition results for the QF_Strings (QF_S, QF_SLIA) division in the Single Query Track.

Page generated on 2020-01-29 22:04:58 +0000

Benchmarks: 27902
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 27664 416805.847 418754.165276641702310641238237 0
Z3str4 0 24252 4297979.273 4294716.324252137481050436503567 0

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 27664 416805.847 418754.165276641702310641238237 0
Z3str4 0 24252 4297979.273 4294716.324252137481050436503567 0

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 17023 144569.695 145992.2151702317023010879237 0
Z3str4 0 13748 3942749.156 3939953.20813748137480141543567 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 10641 27699.598 27946.5761064101064117261237 0
Z3str4 0 10504 124534.698 124253.47810504010504173983567 0

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 27116 29452.982 29355.135271161656610550786785 0
Z3str4 0 24209 92259.64 90592.90324209137051050436933611 0

n Non-competing.