🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
qap15
ns1688926
square41
neos3
support10
s250r10
neos5052403
irish-e
scpm1
s100
stp3d
test33
energy2
neos3025225
L1_six1000
graph40-40
braun
woodlands09
stat96v2
karted
test53
tpl-tub-ws
fhnw-bin1
dlr1
energy1
heimdall
gamora
nebula
test13
test23
Dual2_5000
test93
test63
dlr2
loki
thk_48
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using virtual best as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
ex10
cont1
qap15
nug08-3rd
L1_sixm
datt256
ns1687037
cont11
Linf_520c
scpm1
irish-e
psched3-3
support19
L1_six1000
neos3025225
rmine15
storm_1000
karted
rail02
woodlands09
fhnw-bin1
dlr1
savsched1
heimdall
test73
gamora
test53
groot
test13
test23
thk_63
test63
test93
L2CTA3D
test43
thk_48
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using COPT-6.5.0 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT-6.5.0
time ratios (log scale)
time of COPT-6.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
square41
fome13
ex10
L1_sixm
neos5052403
scpm1
neos5251015
test33
energy2
ns1688926
psched3-3
cont11
cont1
graph40-40
braun
nug08-3rd
test73
neos3025225
storm_1000
L1_six1000
savsched1
Primal2_1000
energy1
fhnw-bin1
set-cover
bdry2
a2864
groot
nebula
test03
test93
dlr2
L2CTA3D
loki
hulk
test63
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using Gurobi-10.0.0 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-10.0.0
time ratios (log scale)
time of Gurobi-10.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔻
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ex10
qap15
L1_sixm
s250r10
cont1
square41
neos
scpm1
Linf_520c
irish-e
energy2
rail4284
savsched1
stp3d
support19
psched3-3
L1_six1000
test33
a2864
test53
test73
fhnw-bin1
s82
cont11
bdry2
braun
dlr1
nebula
stat96v2
test93
test23
energy1
loki
test03
test43
dlr2
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using Optverse-0.2.13 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Optverse-0.2.13
time ratios (log scale)
time of Optverse-0.2.13
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns1688926
s250r10
qap15
neos5052403
stp3d
test33
neos5251015
neos
support19
shs1023
ex10
psched3-3
pds-100
rmine15
s82
graph40-40
energy1
nug08-3rd
karted
woodlands09
L1_six1000
test03
gamora
Primal2_1000
a2864
fhnw-bin1
heimdall
thk_63
thor
hulk
stat96v2
test23
test43
test63
test83
bdry2
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using MOSEK-10.0.24 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MOSEK-10.0.24
time ratios (log scale)
time of MOSEK-10.0.24
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔺
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
support10
psched3-3
irish-e
ex10
neos3
s250r10
square41
neos
braun
savsched1
shs1023
stp3d
L1_sixm
cont1
graph40-40
karted
cont11
L2CTA3D
set-cover
datt256
test53
ns1687037
test03
degme
stat96v2
a2864
gamora
thor
thk_63
hulk
Primal2_1000
test13
test93
test63
test83
bdry2
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using HiGHS-1.4.1 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of HiGHS-1.4.1
time ratios (log scale)
time of HiGHS-1.4.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔺
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
qap15
scpm1
neos3
ex10
rail4284
support10
test33
nug08-3rd
datt256
s250r10
cont1
rmine15
neos5251015
L1_sixm
s100
graph40-40
neos3025225
cont11
loki
hulk
braun
test53
test23
test03
test63
test83
groot
karted
set-cover
degme
L1_six1000
thk_48
Dual2_5000
fhnw-bin1
stat96v2
thor
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using CLP-1.17.7 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of CLP-1.17.7
time ratios (log scale)
time of CLP-1.17.7
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
❌
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
neos5251015
cont11
shs1023
ex10
irish-e
stp3d
fome13
nug08-3rd
neos
storm_1000
datt256
energy2
qap15
rmine15
psched3-3
scpm1
woodlands09
graph40-40
Primal2_1000
s82
braun
ns1687037
energy1
test63
test03
test13
test43
bdry2
dlr1
set-cover
degme
L1_six1000
thk_48
tpl-tub-ws
test93
dlr2
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using MATLAB-R2022b as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MATLAB-R2022b
time ratios (log scale)
time of MATLAB-R2022b
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔺
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
s250r10
ns1688926
neos
neos3025225
qap15
shs1023
gamora
neos3
rmine15
neos5052403
ex10
ns1687037
s82
support19
psched3-3
nebula
rail4284
fhnw-bin1
dlr1
loki
test03
test23
test43
test63
test83
energy1
graph40-40
stat96v2
stp3d
irish-e
scpm1
thk_63
L2CTA3D
dlr2
set-cover
L1_sixm
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using Google-GLOP as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Google-GLOP
time ratios (log scale)
time of Google-GLOP
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
neos
support10
fome13
cont1
neos5052403
psched3-3
irish-e
s100
rail4284
rmine15
pds-100
rail02
qap15
savsched1
cont11
energy2
graph40-40
dlr1
groot
hulk
nebula
test13
test33
test53
test73
Linf_520c
energy1
test93
bdry2
woodlands09
Primal2_1000
thk_63
L2CTA3D
dlr2
set-cover
thor
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
6
7
8
9
10k
2
click to hide/show
CLP-1.17.7
COPT-6.5.0
Google-GLOP
Gurobi-10.0.0
HiGHS-1.4.1
MATLAB-R2022b
MOSEK-10.0.24
Optverse-0.2.13
SOPLEX-6.0.0
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using SOPLEX-6.0.0 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SOPLEX-6.0.0
time ratios (log scale)
time of SOPLEX-6.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark