🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
L1_sixm
ns1688926
square41
cont1
neos5251015
nug08-3rd
s250r10
storm_1000
ns1687037
s100
stp3d
scpm1
graph40-40
neos
psched3-3
L1_six1000
rmine15
woodlands09
test53
degme
dlr1
Primal2_1000
heimdall
gamora
nebula
test03
thor
mars
test93
test63
L2CTA3D
test43
thk_48
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using virtual best as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
fome13
ex10
qap15
support10
s250r10
square41
neos5251015
neos5052403
Linf_520c
irish-e
neos
shs1023
L1_six1000
neos3025225
graph40-40
rmine15
rail02
degme
s82
dlr1
heimdall
bdry2
energy1
test53
groot
test03
thor
thk_63
test63
dlr2
L2CTA3D
test43
thk_48
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using COPT-7.1.0 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT-7.1.0
time ratios (log scale)
time of COPT-7.1.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔺
🔺
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔺
🔺
🔺
🔺
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
fome13
square41
neos3
irish-e
L1_sixm
stp3d
neos5251015
neos
Linf_520c
datt256
cont1
graph40-40
pds-100
woodlands09
rmine15
storm_1000
cont11
degme
Primal2_1000
savsched1
fhnw-bin1
set-cover
heimdall
stat96v2
test03
Dual2_5000
test93
test13
loki
test83
thk_63
thk_48
groot
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using Gurobi-11.0.0 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-11.0.0
time ratios (log scale)
time of Gurobi-11.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
L1_sixm
neos3
neos5052403
square41
ex10
storm_1000
cont1
support10
scpm1
graph40-40
neos
datt256
s100
Linf_520c
shs1023
rmine15
neos3025225
woodlands09
Primal2_1000
s82
bdry2
set-cover
tpl-tub-ws
energy1
groot
hulk
loki
test63
dlr2
L2CTA3D
test93
test03
thk_48
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using MindOpt-1.0.0 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MindOpt-1.0.0
time ratios (log scale)
time of MindOpt-1.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔺
🔺
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔺
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
🔻
🔻
qap15
neos3
ex10
cont1
L1_sixm
support10
datt256
neos
s100
ns1687037
scpm1
shs1023
pds-100
neos3025225
graph40-40
L1_six1000
rail02
woodlands09
tpl-tub-ws
Primal2_1000
fhnw-bin1
energy1
test53
gamora
test03
Dual2_5000
thk_63
dlr2
test63
test93
nebula
thk_48
thor
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using Optverse-0.7.2 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Optverse-0.7.2
time ratios (log scale)
time of Optverse-0.7.2
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns1688926
support10
qap15
fome13
stp3d
square41
neos3
neos3025225
shs1023
scpm1
test53
storm_1000
rail02
tpl-tub-ws
energy1
Linf_520c
woodlands09
datt256
set-cover
cont1
Primal2_1000
cont11
fhnw-bin1
nebula
thk_63
heimdall
dlr2
hulk
bdry2
thk_48
test13
test63
mars
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using MOSEK-10.1.9 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MOSEK-10.1.9
time ratios (log scale)
time of MOSEK-10.1.9
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔺
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
qap15
ex10
support10
L1_sixm
s250r10
irish-e
psched3-3
neos
Linf_520c
graph40-40
cont11
stp3d
L1_six1000
ns1687037
neos3025225
savsched1
tpl-tub-ws
datt256
set-cover
degme
dlr1
test03
test53
Primal2_1000
L2CTA3D
dlr2
test13
test43
groot
loki
heimdall
thk_48
thor
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using XOPT-0.0.6 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of XOPT-0.0.6
time ratios (log scale)
time of XOPT-0.0.6
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔺
🔺
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
support10
psched3-3
fome13
ex10
neos3
s250r10
square41
pds-100
rmine15
shs1023
neos5251015
cont1
graph40-40
storm_1000
nug08-3rd
Linf_520c
datt256
fhnw-bin1
dlr1
heimdall
s82
stat96v2
energy1
groot
L1_six1000
ns1688926
Primal2_1000
loki
Dual2_5000
test13
test93
test83
thk_63
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using HiGHS-1.6.0 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of HiGHS-1.6.0
time ratios (log scale)
time of HiGHS-1.6.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔺
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
❌
❌
🔻
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
qap15
scpm1
neos3
ex10
rail4284
support10
storm_1000
stp3d
woodlands09
gamora
neos5052403
ns1687037
square41
irish-e
savsched1
psched3-3
cont11
loki
hulk
tpl-tub-ws
test63
groot
test03
mars
test83
set-cover
degme
thk_63
Primal2_1000
bdry2
fhnw-bin1
test93
thor
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using CLP-1.17.7 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of CLP-1.17.7
time ratios (log scale)
time of CLP-1.17.7
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔺
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
neos5251015
cont11
shs1023
ex10
irish-e
stp3d
fome13
groot
heimdall
s250r10
nebula
qap15
rmine15
psched3-3
savsched1
rail4284
stat96v2
L1_sixm
hulk
ns1687037
energy1
test63
test13
rail02
loki
bdry2
neos3
dlr2
L2CTA3D
thk_48
tpl-tub-ws
fhnw-bin1
thk_63
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using MATLAB-R2022b as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MATLAB-R2022b
time ratios (log scale)
time of MATLAB-R2022b
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔺
🔺
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔺
🔺
🔺
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
s250r10
ns1688926
neos
neos5251015
fome13
storm_1000
Linf_520c
cont1
pds-100
datt256
savsched1
heimdall
square41
psched3-3
nebula
rail4284
energy1
groot
hulk
rail02
test03
test43
test63
set-cover
dlr2
L1_six1000
thk_48
Dual2_5000
graph40-40
irish-e
nug08-3rd
scpm1
L1_sixm
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using Google-GLOP as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Google-GLOP
time ratios (log scale)
time of Google-GLOP
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
neos
support10
fome13
cont1
neos5052403
psched3-3
irish-e
s100
rail4284
rmine15
pds-100
rail02
qap15
savsched1
cont11
graph40-40
test93
test63
test43
test03
mars
hulk
groot
energy1
set-cover
L2CTA3D
thk_63
Primal2_1000
woodlands09
Linf_520c
bdry2
dlr1
thor
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
6
7
8
9
10k
2
click to hide/show
CLP-1.17.7
COPT-7.1.0
Google-GLOP
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
Optverse-0.7.2
SOPLEX-6.0.0
XOPT-0.0.6
virtual best
LPopt Benchmark (find optimal basic solution)
shifted time ratios (shift=10 seconds) using SOPLEX-6.0.0 as base solver (13 Apr 2024) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SOPLEX-6.0.0
time ratios (log scale)
time of SOPLEX-6.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark