The International Satisfiability Modulo Theories (SMT) Competition.
Competition results for the QF_FPArith (QF_FP, QF_UFFP, QF_FPLRA, QF_BVFP, QF_ABVFP, QF_BVFPLRA, QF_ABVFPLRA) division in the Single Query Track.
Page generated on 2020-01-29 22:04:58 +0000
Benchmarks: 1367 Time Limit: 2400 seconds Memory Limit: 60 GB
Sequential Performance | Parallel Performance | SAT Performance (parallel) | UNSAT Performance (parallel) | 24s Performance (parallel) |
---|---|---|---|---|
CVC4 | CVC4 | CVC4 | CVC4 | CVC4 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
CVC4 | 0 | 1356 | 164648.177 | 164624.077 | 1356 | 617 | 739 | 106 | 106 | 0 |
MathSAT5n | 0 | 1355 | 147501.041 | 147456.55 | 1355 | 626 | 729 | 107 | 99 | 0 |
COLIBRI | 0 | 1248 | 124996.309 | 124949.936 | 1248 | 591 | 657 | 214 | 100 | 0 |
Bitwuzla-fixedn | 0 | 1128 | 69645.231 | 69648.282 | 1128 | 414 | 714 | 38 | 38 | 0 |
Bitwuzla | 0 | 1128 | 69805.954 | 69762.859 | 1128 | 414 | 714 | 38 | 38 | 0 |
2019-Par4n | 0 | 614 | 138742.656 | 126405.837 | 614 | 307 | 307 | 50 | 50 | 0 |
z3n | 0 | 597 | 185452.199 | 185484.904 | 597 | 331 | 266 | 124 | 122 | 2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
CVC4 | 0 | 1356 | 164648.177 | 164624.077 | 1356 | 617 | 739 | 106 | 106 | 0 |
MathSAT5n | 0 | 1355 | 147501.041 | 147456.55 | 1355 | 626 | 729 | 107 | 99 | 0 |
COLIBRI | 0 | 1248 | 124996.309 | 124949.936 | 1248 | 591 | 657 | 214 | 100 | 0 |
Bitwuzla-fixedn | 0 | 1128 | 69645.231 | 69648.282 | 1128 | 414 | 714 | 38 | 38 | 0 |
Bitwuzla | 0 | 1128 | 69805.954 | 69762.859 | 1128 | 414 | 714 | 38 | 38 | 0 |
2019-Par4n | 0 | 617 | 197036.046 | 65857.67 | 617 | 310 | 307 | 47 | 47 | 0 |
z3n | 0 | 597 | 185452.199 | 185484.904 | 597 | 331 | 266 | 124 | 122 | 2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
MathSAT5n | 0 | 626 | 39407.657 | 39385.452 | 626 | 626 | 0 | 836 | 99 | 0 |
CVC4 | 0 | 617 | 60471.121 | 60463.362 | 617 | 617 | 0 | 845 | 106 | 0 |
COLIBRI | 0 | 591 | 52019.89 | 52022.32 | 591 | 591 | 0 | 871 | 100 | 0 |
Bitwuzla | 0 | 414 | 13940.439 | 13940.354 | 414 | 414 | 0 | 752 | 38 | 0 |
Bitwuzla-fixedn | 0 | 414 | 13942.321 | 13945.568 | 414 | 414 | 0 | 752 | 38 | 0 |
z3n | 0 | 331 | 81604.756 | 81622.929 | 331 | 331 | 0 | 390 | 122 | 2 |
2019-Par4n | 0 | 310 | 78850.725 | 26367.626 | 310 | 310 | 0 | 354 | 47 | 0 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
CVC4 | 0 | 739 | 87379.296 | 87360.166 | 739 | 0 | 739 | 723 | 106 | 0 |
MathSAT5n | 0 | 729 | 91296.094 | 91270.378 | 729 | 0 | 729 | 733 | 99 | 0 |
Bitwuzla-fixedn | 0 | 714 | 38905.811 | 38902.063 | 714 | 0 | 714 | 452 | 38 | 0 |
Bitwuzla | 0 | 714 | 39067.375 | 39021.845 | 714 | 0 | 714 | 452 | 38 | 0 |
COLIBRI | 0 | 657 | 56447.722 | 56397.336 | 657 | 0 | 657 | 805 | 100 | 0 |
2019-Par4n | 0 | 307 | 71396.952 | 23888.904 | 307 | 0 | 307 | 357 | 47 | 0 |
z3n | 0 | 266 | 88248.783 | 88261.466 | 266 | 0 | 266 | 455 | 122 | 2 |
Solver | Error Score | Correct Score | CPU Time Score | Wall Time Score | Solved | Solved SAT | Solved UNSAT | Unsolved | Timeout | Memout |
---|---|---|---|---|---|---|---|---|---|---|
CVC4 | 0 | 1223 | 8669.174 | 8617.329 | 1223 | 557 | 666 | 239 | 239 | 0 |
MathSAT5n | 0 | 1218 | 8549.151 | 8499.619 | 1218 | 556 | 662 | 244 | 236 | 0 |
COLIBRI | 0 | 1211 | 5112.972 | 5104.218 | 1211 | 579 | 632 | 251 | 138 | 0 |
Bitwuzla | 0 | 1041 | 4452.571 | 4435.794 | 1041 | 377 | 664 | 125 | 125 | 0 |
Bitwuzla-fixedn | 0 | 1041 | 4447.158 | 4438.425 | 1041 | 377 | 664 | 125 | 125 | 0 |
2019-Par4n | 0 | 573 | 3992.373 | 2940.795 | 573 | 286 | 287 | 91 | 91 | 0 |
z3n | 0 | 437 | 8393.566 | 8390.548 | 437 | 232 | 205 | 284 | 282 | 2 |
n Non-competing.