🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔻
🔻
🔻
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
10074
10073
10040
10042
10044
10046
10049
10055
10052
10072
10068
10066
10064
10062
10061
10051
3834
10070
7144
3815
10054
3714
3762
1976
7149
10048
5725
10058
5935
5971
2087
2047
0633
2055
5881
3402
3923
3506
2060
3772
5962
3587
7164
2085
2492
2073
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Gurobi-9.5.0 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-9.5.0
time ratios (log scale)
time of Gurobi-9.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
10074
10043
10046
10049
10040
10059
10073
10062
10064
10042
0067
3852
3565
10066
7127
1976
5944
3714
10068
3762
2087
3705
2047
7144
10055
3751
7149
5935
3757
2357
3506
3803
7154
10054
5881
2073
3775
6799
10058
6757
0633
3413
2085
5721
3931
2492
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using OCTERACT-4.3.0 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of OCTERACT-4.3.0
time ratios (log scale)
time of OCTERACT-4.3.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔺
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
10074
10072
10053
10049
10064
10062
10057
3834
10063
2047
3614
2512
3380
10042
3587
1976
3714
3402
3803
2060
2359
10052
3413
10054
10051
10059
10044
2073
10066
10068
0752
3565
10041
3815
3751
3883
5721
3745
5962
5980
6757
3738
7144
7154
7164
3705
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Baron-22.1.8 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Baron-22.1.8
time ratios (log scale)
time of Baron-22.1.8
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
5755
3852
3565
0067
5725
3714
3705
2512
3834
2087
5971
2357
2055
3757
3745
10072
10073
10045
10055
10048
10051
10053
10047
10043
10060
10062
10064
10066
10068
10071
10042
10040
3772
3587
3506
3877
3923
5721
3254
2492
2085
6324
6799
0633
3738
10041
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
5
10
2
5
100
2
5
1000
2
5
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using FSCIP-7.0.0 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of FSCIP-7.0.0
time ratios (log scale)
time of FSCIP-7.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
🔻
🔻
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
5755
3852
3762
3565
0067
5980
3705
3380
2359
3751
5971
3745
3757
5935
2047
10054
10052
10049
3614
10046
10044
10055
10058
10060
10062
10064
10066
10068
10071
10042
7164
3587
3775
3402
3254
3883
3931
2492
2085
2073
2067
6324
6799
0752
7154
5881
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
5
10
2
5
100
2
5
1000
2
5
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using SCIP-8.0.0 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIP-8.0.0
time ratios (log scale)
time of SCIP-8.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
❌
🔻
🔻
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
0067
2055
3380
2087
5944
7127
3714
6324
3834
5881
3852
7139
10049
10048
10042
10045
10043
10044
10052
10071
10068
10066
10064
10062
10060
10058
10054
10051
5935
3738
3587
3506
3745
2492
2085
0752
3254
3751
6799
5980
5962
3757
3931
3883
3832
5721
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using ANTIGONE-1.1 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of ANTIGONE-1.1
time ratios (log scale)
time of ANTIGONE-1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
❌
❌
3762
5980
0067
5935
10047
10045
10043
10041
7164
7154
7144
7127
6757
10049
10052
10071
10068
10066
10064
10063
10060
10058
10055
10053
2060
5962
3705
3587
3506
3402
3254
2492
2357
2085
3738
3751
1976
5881
5725
3931
0752
3852
3832
3803
3772
3877
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
click to hide/show
ANTIGONE-1.1
Baron-22.1.8
FSCIP-7.0.0
Gurobi-9.5.0
MINOTAUR-0.2.1
OCTERACT-4.3.0
SCIP-8.0.0
Binary Non-Convex QPLIB Benchmark
shifted time ratios (shift=10 seconds) using MINOTAUR-0.2.1 as base solver (1 May 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MINOTAUR-0.2.1
time ratios (log scale)
time of MINOTAUR-0.2.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark