Equality+MachineArith (AUFFPDTLIRA, UFFPDTLIRA, UFFPDTNIRA, ABVFP, ABVFPLRA, UFBV, AUFBVDTLIA) - Single Query Track

Competition results for the Equality+MachineArith (AUFFPDTLIRA, UFFPDTLIRA, UFFPDTNIRA, ABVFP, ABVFPLRA, UFBV, AUFBVDTLIA) division in the Single Query Track.

Page generated on 2020-01-29 22:04:58 +0000

Benchmarks: 1408
Time Limit: 2400 seconds
Memory Limit: 60 GB

Winners

Sequential Performance	Parallel Performance	SAT Performance (parallel)	UNSAT Performance (parallel)	24s Performance (parallel)
CVC4	CVC4	CVC4	CVC4	CVC4

Sequential Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	907	474068.3	486414.6	907	208	699	501	351	0
2018-Z3n	0	50	26465.545	26470.293	50	18	32	22	22	0
2019-Par4n	0	50	52530.2	26470.347	50	18	32	22	22	0
z3n	0	49	27629.809	27634.255	49	18	31	23	23	0
UltimateEliminator+MathSAT	0	16	9497.598	7963.944	16	10	6	1392	3	0
2018-CVC4n	0	15	13710.212	13712.736	15	13	2	15	10	0

Parallel Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	907	474068.3	486414.6	907	208	699	501	351	0
2018-Z3n	0	50	26465.545	26470.293	50	18	32	22	22	0
2019-Par4n	0	50	52530.2	26470.347	50	18	32	22	22	0
z3n	0	49	27629.809	27634.255	49	18	31	23	23	0
UltimateEliminator+MathSAT	0	16	9497.598	7963.944	16	10	6	1392	3	0
2018-CVC4n	0	15	13710.212	13712.736	15	13	2	15	10	0

SAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	208	50199.701	52916.131	208	208	0	1200	351	0
z3n	0	18	2.163	2.164	18	18	0	54	23	0
2019-Par4n	0	18	1.352	2.844	18	18	0	54	22	0
2018-Z3n	0	18	3.006	3.007	18	18	0	54	22	0
2018-CVC4n	0	13	3.626	3.623	13	13	0	17	10	0
UltimateEliminator+MathSAT	0	10	1572.597	1319.888	10	10	0	1398	3	0

UNSAT Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	699	18601.811	19090.534	699	0	699	709	351	0
2019-Par4n	0	32	2520.337	1266.083	32	0	32	40	22	0
2018-Z3n	0	32	1266.358	1266.456	32	0	32	40	22	0
z3n	0	31	2430.636	2430.891	31	0	31	41	23	0
UltimateEliminator+MathSAT	0	6	2309.368	1617.384	6	0	6	1402	3	0
2018-CVC4n	0	2	0.144	0.144	2	0	2	28	10	0

24 seconds Performance

Solver	Error Score	Correct Score	CPU Time Score	Wall Time Score	Solved	Solved SAT	Solved UNSAT	Unsolved	Timeout	Memout
CVC4	0	708	14443.505	14441.267	708	63	645	700	585	0
z3n	0	49	584.839	584.845	49	18	31	23	23	0
2019-Par4n	0	49	614.22	588.338	49	18	31	23	23	0
2018-Z3n	0	49	588.933	588.937	49	18	31	23	23	0
UltimateEliminator+MathSAT	0	16	4832.916	3456.876	16	10	6	1392	7	0
2018-CVC4n	0	15	311.042	311.045	15	13	2	15	12	0

n Non-competing.