🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
3565
3705
5755
5725
5721
3852
3745
5881
3738
3877
3506
3832
5882
3706
5875
3838
5909
3822
3693
3650
3642
3850
5922
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using virtual best as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
3565
3705
5755
5725
5721
3852
3745
5881
3738
3877
3506
3832
5882
3706
5875
3838
5909
3822
3693
3650
3642
3850
5922
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using QuBowl as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of QuBowl
time ratios (log scale)
time of QuBowl
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
5755
5721
3852
3565
3705
5725
3745
5881
3738
3506
3832
3877
3706
5882
5875
3838
5909
3822
3693
3650
3642
3850
5922
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Gurobi-10.0.1 as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-10.0.1
time ratios (log scale)
time of Gurobi-10.0.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
5755
3565
3852
3705
5725
3745
3738
3506
5881
3877
3832
3706
5882
5875
5721
3838
5909
3822
3693
3650
3642
3850
5922
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using OCTERACT-4.7.1 as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of OCTERACT-4.7.1
time ratios (log scale)
time of OCTERACT-4.7.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
3565
5755
3852
3705
5725
3745
3738
3506
3877
3832
5881
3706
5882
5875
5721
3838
5909
3822
3693
3650
3642
3850
5922
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Baron-23.1.5 as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Baron-23.1.5
time ratios (log scale)
time of Baron-23.1.5
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔺
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔺
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
5755
5725
5721
3852
3565
3705
3745
5881
3738
3506
5882
5875
3877
3838
5909
3832
3822
3706
3693
3650
3642
3850
5922
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using SHOT-1.1 as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SHOT-1.1
time ratios (log scale)
time of SHOT-1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
5755
5725
3565
3705
3852
3745
5881
3738
3506
3877
3832
3706
5882
5875
5721
3838
5909
3822
3693
3650
3642
3850
5922
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using McSparse-2.0 as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of McSparse-2.0
time ratios (log scale)
time of McSparse-2.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
5755
3852
3565
5725
3705
3745
5881
3738
3506
5882
5875
5721
3877
3838
5909
3832
3822
3706
3693
3650
3642
3850
5922
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using SCIP-8.0 as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIP-8.0
time ratios (log scale)
time of SCIP-8.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔺
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔺
🔺
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔺
🔺
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔺
🔺
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
🔺
🔻
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
5881
5882
5721
3506
5875
5755
5725
3877
3852
3850
5909
3838
3822
3745
3738
3706
3705
3693
3650
3642
3565
3832
5922
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
click to hide/show
Baron-23.1.5
BQCRUNCH
Gurobi-10.0.1
McSparse-2.0
OCTERACT-4.7.1
QuBowl
SCIP-8.0
SHOT-1.1
virtual best
Nonconvex QUBO-QPLIB Benchmark
shifted time ratios (shift=10 seconds) using BQCRUNCH as base solver (19 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of BQCRUNCH
time ratios (log scale)
time of BQCRUNCH
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark