🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
❌
3680
3514
3600
3496
3748
3814
3554
9048
3620
3677
3683
3580
3279
8381
3645
3725
2882
3060
3651
3512
3621
4095
0681
10025
3513
2171
0682
3816
2958
3785
3643
2202
3525
2203
2195
3870
3562
3692
0696
3794
3699
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using Gurobi-9.5.0 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-9.5.0
time ratios (log scale)
time of Gurobi-9.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
8153
8381
3855
3645
3813
3677
3624
0031
3060
3676
0032
3643
2882
0681
8009
3512
4095
3725
3719
3728
9030
3794
0698
10025
3870
3785
2202
2203
2958
3513
3515
3525
3562
3582
3600
3621
2173
2170
3662
3680
10027
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using SCIP-8.0.0 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIP-8.0.0
time ratios (log scale)
time of SCIP-8.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
3814
3692
3699
2702
0684
3060
3620
3512
0681
3813
3496
9030
3677
3690
3683
9048
3680
3719
4722
3872
3748
3790
3794
3725
0031
0032
0696
2165
2171
2187
2195
2203
2935
3513
3523
3554
3582
3621
3643
3651
10027
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using Baron-21.1.13 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Baron-21.1.13
time ratios (log scale)
time of Baron-21.1.13
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
3814
3699
8153
3562
3514
2882
3794
3813
3728
3748
3690
3600
0696
0032
3677
3790
2167
3725
2170
0684
3816
3857
3872
4722
8381
10025
3697
3683
2204
3512
2202
3525
2195
3692
2192
10026
3643
2187
3662
2173
10027
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using ANTIGONE-1.1 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of ANTIGONE-1.1
time ratios (log scale)
time of ANTIGONE-1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
3122
2167
3699
2173
8153
9048
3279
2171
3562
2192
3728
3680
3697
3690
3719
3809
9030
8009
4095
3872
3855
3677
3813
3676
3651
0681
0684
2165
2187
2204
2935
3496
3512
3515
3525
3582
3620
10026
3643
3646
10027
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using OCTERACT-4.0.0 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of OCTERACT-4.0.0
time ratios (log scale)
time of OCTERACT-4.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
❌
❌
🔺
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
3814
9048
3514
3646
3725
3699
3683
3680
3676
3651
3692
3785
10025
8381
8009
4095
3870
3855
3809
3790
3624
3621
2203
2195
2187
2702
2165
0696
0682
0032
10026
2958
3600
3582
3562
2935
3515
3512
3279
3060
10027
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using COUENNE-0.5 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COUENNE-0.5
time ratios (log scale)
time of COUENNE-0.5
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
2702
3514
0031
3725
3699
3692
3683
3677
3662
3646
3748
3790
9048
8381
4722
3645
3857
3816
3813
3794
3643
10026
2202
2192
2173
2204
2165
0696
0682
0032
3624
2958
3620
3596
3580
2935
3523
3513
3496
3060
10027
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
2
3
4
5
6
7
8
9
1000
2
3
4
5
6
7
8
9
10k
click to hide/show
ANTIGONE-1.1
Baron-21.1.13
COUENNE-0.5
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.0.0
SCIP-8.0.0
Discrete Non-Convex QPLIB Benchmark (non-binary)
shifted time ratios (shift=10 seconds) using MINOTAUR-0.2.1 as base solver (15 Jan 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MINOTAUR-0.2.1
time ratios (log scale)
time of MINOTAUR-0.2.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark