🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
2167
3728
3790
3496
3514
3596
8153
9030
3554
3580
3683
3624
2702
8381
3122
3719
2173
3855
0031
3809
3872
0684
10026
10025
3513
0032
2165
3816
2958
3785
3582
2202
3525
2203
2195
3870
3562
4722
3692
3794
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using Gurobi-9.5.0 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-9.5.0
time ratios (log scale)
time of Gurobi-9.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
8153
8381
3727
3646
3645
3677
9048
2702
2202
2167
3676
0684
3643
3122
3816
8009
2935
0682
3562
3728
10025
3785
3809
3697
3870
3857
3680
0698
2170
2173
2192
2203
2958
3513
3523
3554
3582
3600
3651
3683
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using SCIP-7.0.3.5 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIP-7.0.3.5
time ratios (log scale)
time of SCIP-7.0.3.5
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
3814
3692
3699
2702
0684
3060
3620
3512
0681
3813
3496
9030
3677
3690
3683
9048
3697
3872
3870
3857
3728
3785
3790
3719
3621
0032
0696
2165
2171
2187
2195
2203
2204
3513
3523
3554
3582
10026
3645
2935
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using Baron-21.1.13 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Baron-21.1.13
time ratios (log scale)
time of Baron-21.1.13
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
3814
3699
8153
3562
3514
2882
3794
3813
3728
3748
3690
3600
0696
0032
3677
3719
3692
3785
3816
3870
4722
8381
10025
3676
3651
0682
0698
2167
2171
2187
2195
2203
2702
3512
3523
3554
3582
10026
3643
3662
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using ANTIGONE-1.1 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of ANTIGONE-1.1
time ratios (log scale)
time of ANTIGONE-1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔺
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
❌
2167
8153
9048
3060
3279
3523
3814
3719
3727
3692
3680
3676
3697
0031
3651
3809
3816
3857
3872
8009
10025
3646
3643
2203
2195
2187
2171
0696
0682
0032
2935
3122
3622
3620
3596
3580
3525
3514
3512
3645
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using OCTERACT-3.6.0 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of OCTERACT-3.6.0
time ratios (log scale)
time of OCTERACT-3.6.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔺
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
3814
9048
3514
3646
3662
3677
3683
3645
3692
3699
3651
0031
10025
8381
8009
3872
3857
3816
3794
3785
3748
3620
2202
2192
2173
2170
0698
0684
0681
2204
2882
3600
3582
3562
3525
3523
3512
3279
3060
3515
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using COUENNE-0.5 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COUENNE-0.5
time ratios (log scale)
time of COUENNE-0.5
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
2702
3514
0031
3719
3697
3690
3680
3676
3651
3645
3728
3785
9048
8381
4722
3643
3855
3814
3809
3790
3624
10026
2195
2187
2171
2167
0698
0684
0681
2203
2882
3620
3596
3580
3554
3525
3513
3496
3060
3523
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
2
3
4
5
6
7
8
9
1000
2
3
4
5
6
7
8
9
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-3.6.0
SCIP-7.0.3.5
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using MINOTAUR-0.2.1 as base solver (1 Dec 2021) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MINOTAUR-0.2.1
time ratios (log scale)
time of MINOTAUR-0.2.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark