🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
3514
3727
3814
3813
8153
9048
3646
3624
3122
3690
2702
3676
3645
3872
2882
3596
3621
0684
3816
2935
0682
2165
3643
4805
3562
3513
3857
2170
3525
10020
2192
3870
2187
0696
3692
3680
3515
3794
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using Gurobi-9.1.0 as base solver (10 Nov 2020)
instances sorted by solving time of Gurobi-9.1.0
time ratios (log scale)
time of Gurobi-9.1.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
8153
3814
2167
3813
3622
3620
3690
2702
3596
3496
4805
3060
0684
2958
5442
3748
10020
3680
5023
3728
3794
3870
3855
3643
0682
2165
2171
2187
2195
2203
3122
3279
3512
3515
3525
3562
10022
3651
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using FSCIP-7.0.0 as base solver (10 Nov 2020)
instances sorted by solving time of FSCIP-7.0.0
time ratios (log scale)
time of FSCIP-7.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
8153
2167
2173
3596
3645
3646
3060
2202
3814
3496
3677
3624
0684
3122
2958
3515
3794
2170
3855
3870
2165
5023
0696
0032
9048
3748
2187
3523
3554
3512
10022
3505
3279
2702
2204
3680
2192
3643
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using SCIP-7.0.0 as base solver (10 Nov 2020)
instances sorted by solving time of SCIP-7.0.0
time ratios (log scale)
time of SCIP-7.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
3814
3692
2702
3279
3727
3060
3646
8381
3622
0681
3562
3624
2882
0682
3645
10020
8009
3725
4805
3728
3790
3872
3857
3816
3651
0696
2170
2173
2192
2202
2204
2958
3505
3515
3525
3600
3621
3676
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using Baron-20.10.16 as base solver (10 Nov 2020)
instances sorted by solving time of Baron-20.10.16
time ratios (log scale)
time of Baron-20.10.16
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
🔻
🔻
3814
3699
8153
3562
3514
2882
3794
3813
3728
3748
3690
3600
0696
0032
3677
2170
2165
0684
3816
3870
4722
5023
8009
9030
3857
2173
3181
2204
3512
2203
3525
2171
10022
2195
3643
2192
3676
3596
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using ANTIGONE-1.1 as base solver (10 Nov 2020)
instances sorted by solving time of ANTIGONE-1.1
time ratios (log scale)
time of ANTIGONE-1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔺
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
3692
2702
3790
3554
3748
3727
0031
3677
3651
3645
3690
3813
9048
8381
8009
5023
4722
3870
3855
3643
3620
2202
2192
2173
2203
2165
0684
0681
2167
2204
10022
3562
3515
2882
3505
3279
3122
3512
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using OCTERACT-1.07.29 as base solver (10 Nov 2020)
instances sorted by solving time of OCTERACT-1.07.29
time ratios (log scale)
time of OCTERACT-1.07.29
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔺
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
❌
❌
🔺
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
3814
9048
3514
3646
5442
3645
3651
3677
3680
3692
3725
3728
3790
3624
3816
3857
3872
4805
8009
3620
2204
2202
2192
2173
2170
0696
0682
0032
3621
2958
3596
3554
3523
3513
3505
3279
3122
2935
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using COUENNE-0.5 as base solver (10 Nov 2020)
instances sorted by solving time of COUENNE-0.5
time ratios (log scale)
time of COUENNE-0.5
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
2702
3514
3728
3725
3692
0031
3677
3651
3645
3748
3794
10020
9030
8009
5023
4722
3870
3855
3814
3622
10022
2195
2187
2171
2170
0696
0682
0032
2204
2935
3596
3554
3523
3513
3505
3279
3060
3621
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
2
3
4
5
6
7
8
9
1000
2
3
4
5
6
7
8
9
10k
click to hide/show
ANTIGONE-1.1
Baron-20.10.16
COUENNE-0.5
FSCIP-7.0.0
Gurobi-9.1.0
MINOTAUR-0.2.1
OCTERACT-1.07.29
SCIP-7.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using MINOTAUR-0.2.1 as base solver (10 Nov 2020)
instances sorted by solving time of MINOTAUR-0.2.1
time ratios (log scale)
time of MINOTAUR-0.2.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark