🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
❌
❌
❌
❌
3698
3694
3792
3708
3871
4270
10002
10001
10009
10010
10012
10050
10069
10056
3861
3547
10008
10011
10003
10004
7579
5577
10007
5924
10005
10006
3678
5527
5543
3913
3980
1
2
4
8
16
32
64
128
256
512
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using virtual best as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
3698
3694
3792
3708
4270
10069
10050
10001
10056
3861
10002
10010
3871
3547
10009
10008
10012
10011
10003
7579
5577
10007
5924
10004
3678
3913
3980
5527
5543
10006
10005
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using GUROBI 11.0.0 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of GUROBI 11.0.0
time ratios (log scale)
time of GUROBI 11.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
3698
3694
3871
10056
10069
10010
10002
10001
10012
10009
10008
3708
3792
3861
10011
10050
10003
10004
4270
5577
7579
5924
10007
3547
5543
3913
3980
5527
3678
10006
10005
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using COPT 7.1.0 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT 7.1.0
time ratios (log scale)
time of COPT 7.1.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
3698
3694
3792
3708
10056
10069
10050
10001
3861
3547
10002
10010
3871
4270
10009
10008
10012
10011
10003
7579
5577
10007
5924
10004
3678
3913
3980
5527
5543
10006
10005
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Shot 1.1 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Shot 1.1
time ratios (log scale)
time of Shot 1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
10050
10056
10069
3871
10001
3708
10002
10009
4270
10010
10008
7579
10012
3792
10011
3698
3547
3694
3861
5924
3913
3678
3980
5527
5543
5577
10007
10004
10003
10006
10005
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Baron 24.5.8 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Baron 24.5.8
time ratios (log scale)
time of Baron 24.5.8
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
3708
10069
10004
10001
10010
10050
3871
10009
7579
3792
4270
10002
3698
3694
3861
10005
10006
3547
5543
5577
3913
3980
3678
5527
5924
10008
10003
10007
10012
10011
10056
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using MOSEK 10.2.2 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MOSEK 10.2.2
time ratios (log scale)
time of MOSEK 10.2.2
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
3708
10056
10069
10050
3871
10001
3792
3698
3694
7579
4270
3861
3547
10010
10004
5924
5543
5577
3980
5527
3913
3678
10002
10003
10008
10007
10006
10005
10012
10011
10009
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using KNITRO 14.0.0 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of KNITRO 14.0.0
time ratios (log scale)
time of KNITRO 14.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
10001
10010
3708
10009
10002
5577
10008
5924
7579
4270
10012
10003
10007
10011
3694
3547
5543
3913
3980
5527
3698
3792
3861
3871
3678
10005
10004
10006
10050
10056
10069
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using SCIP 9.0.0 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIP 9.0.0
time ratios (log scale)
time of SCIP 9.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
❌
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔺
🔻
❌
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
10069
10056
10050
3708
3871
10001
3792
3547
3913
3980
4270
5527
3698
3694
3678
3861
7579
5924
5577
5543
10005
10002
10003
10004
10008
10007
10006
10009
10012
10011
10010
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using Bonmin 1.8.7 as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Bonmin 1.8.7
time ratios (log scale)
time of Bonmin 1.8.7
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
3708
10001
10009
10008
10002
10010
10012
10011
3913
3547
3694
3678
3698
3792
3861
3871
7579
5924
5577
5543
5527
4270
3980
10003
10007
10006
10005
10004
10050
10056
10069
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
Baron 24.5.8
Bonmin 1.8.7
COPT 7.1.0
GUROBI 11.0.0
KNITRO 14.0.0
MNTAUR
MOSEK 10.2.2
SCIP 9.0.0
Shot 1.1
virtual best
Convex Discrete QPLIB Benchmark
shifted time ratios (shift=10 seconds) using MNTAUR as base solver (10 Aug 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MNTAUR
time ratios (log scale)
time of MNTAUR
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark