SMT-COMP

The International Satisfiability Modulo Theories (SMT) Competition.

Participants
Results

QF_FPArith (QF_FP, QF_UFFP, QF_FPLRA, QF_BVFP, QF_ABVFP, QF_BVFPLRA, QF_ABVFPLRA) - Single Query Track

Competition results for the QF_FPArith (QF_FP, QF_UFFP, QF_FPLRA, QF_BVFP, QF_ABVFP, QF_BVFPLRA, QF_ABVFPLRA) division in the Single Query Track.

Page generated on 2020-01-29 22:04:58 +0000

Benchmarks: 1367
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential PerformanceParallel PerformanceSAT Performance (parallel)UNSAT Performance (parallel)24s Performance (parallel)
CVC4CVC4CVC4 CVC4 CVC4

Sequential Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 1356 164648.177 164624.0771356617739106106 0
MathSAT5n 0 1355 147501.041 147456.55135562672910799 0
COLIBRI 0 1248 124996.309 124949.9361248591657214100 0
Bitwuzla-fixedn 0 1128 69645.231 69648.28211284147143838 0
Bitwuzla 0 1128 69805.954 69762.85911284147143838 0
2019-Par4n 0 614 138742.656 126405.8376143073075050 0
z3n 0 597 185452.199 185484.904597331266124122 2

Parallel Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 1356 164648.177 164624.0771356617739106106 0
MathSAT5n 0 1355 147501.041 147456.55135562672910799 0
COLIBRI 0 1248 124996.309 124949.9361248591657214100 0
Bitwuzla-fixedn 0 1128 69645.231 69648.28211284147143838 0
Bitwuzla 0 1128 69805.954 69762.85911284147143838 0
2019-Par4n 0 617 197036.046 65857.676173103074747 0
z3n 0 597 185452.199 185484.904597331266124122 2

SAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
MathSAT5n 0 626 39407.657 39385.452626626083699 0
CVC4 0 617 60471.121 60463.3626176170845106 0
COLIBRI 0 591 52019.89 52022.325915910871100 0
Bitwuzla 0 414 13940.439 13940.354414414075238 0
Bitwuzla-fixedn 0 414 13942.321 13945.568414414075238 0
z3n 0 331 81604.756 81622.9293313310390122 2
2019-Par4n 0 310 78850.725 26367.626310310035447 0

UNSAT Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 739 87379.296 87360.1667390739723106 0
MathSAT5n 0 729 91296.094 91270.378729072973399 0
Bitwuzla-fixedn 0 714 38905.811 38902.063714071445238 0
Bitwuzla 0 714 39067.375 39021.845714071445238 0
COLIBRI 0 657 56447.722 56397.3366570657805100 0
2019-Par4n 0 307 71396.952 23888.904307030735747 0
z3n 0 266 88248.783 88261.4662660266455122 2

24 seconds Performance

Solver Error Score Correct Score CPU Time Score Wall Time ScoreSolvedSolved SATSolved UNSATUnsolvedTimeout Memout
CVC4 0 1223 8669.174 8617.3291223557666239239 0
MathSAT5n 0 1218 8549.151 8499.6191218556662244236 0
COLIBRI 0 1211 5112.972 5104.2181211579632251138 0
Bitwuzla 0 1041 4452.571 4435.7941041377664125125 0
Bitwuzla-fixedn 0 1041 4447.158 4438.4251041377664125125 0
2019-Par4n 0 573 3992.373 2940.7955732862879191 0
z3n 0 437 8393.566 8390.548437232205284282 2

n Non-competing.