🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
L1_sixm
a2864
cont11
qap15
nug08-3rd
graph40-40
neos3
neos5251015
irish-e
ns1687037
woodlands09
stp3d
Linf_520c
s250r10
test63
savsched1
karted
psched3-3
neos
shs1023
rail4284
test13
rmine15
degme
test53
tpl-tub-ws
fhnw-bin1
s82
energy1
set-cover
thk_63
test03
Dual2_5000
dlr2
test83
thk_48
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using virtual best as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
L1_sixm
neos3
fome13
nug08-3rd
cont1
datt256
square41
ns1688926
s250r10
woodlands09
scpm1
test63
neos5052403
support19
bdry2
shs1023
neos3025225
braun
irish-e
test13
stat96v2
rail4284
rail02
tpl-tub-ws
fhnw-bin1
heimdall
energy1
set-cover
test53
groot
thor
thk_63
Dual2_5000
dlr2
test43
thk_48
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using COPT-6.5.0 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT-6.5.0
time ratios (log scale)
time of COPT-6.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
neos3
graph40-40
qap15
ex10
square41
cont11
support10
stp3d
scpm1
s100
neos5052403
bdry2
savsched1
karted
energy2
psched3-3
braun
stat96v2
test23
pds-100
test73
rail02
tpl-tub-ws
test63
Primal2_1000
heimdall
gamora
fhnw-bin1
nebula
groot
test93
Dual2_5000
dlr2
loki
test83
thk_48
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using Gurobi-10.0.0 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-10.0.0
time ratios (log scale)
time of Gurobi-10.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
ns1688926
datt256
groot
s250r10
support10
fome13
irish-e
square41
neos5251015
cont11
neos3025225
savsched1
support19
ex10
nug08-3rd
energy2
scpm1
psched3-3
storm_1000
Primal2_1000
braun
s82
test23
test63
fhnw-bin1
karted
test93
test03
thk_63
gamora
loki
heimdall
test83
dlr2
hulk
ns1687037
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using MOSEK-10.0.25 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MOSEK-10.0.25
time ratios (log scale)
time of MOSEK-10.0.25
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
nug08-3rd
datt256
energy2
qap15
savsched1
fome13
a2864
scpm1
stp3d
L2CTA3D
pds-100
s250r10
tpl-tub-ws
test33
set-cover
test03
Linf_520c
degme
stat96v2
test43
storm_1000
shs1023
L1_six1000
Primal2_1000
thk_63
s100
fhnw-bin1
heimdall
dlr1
test23
groot
hulk
ns1687037
ns1688926
dlr2
thor
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using ORTOOLS-9.6 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of ORTOOLS-9.6
time ratios (log scale)
time of ORTOOLS-9.6
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
support10
ex10
neos3
fome13
irish-e
scpm1
cont1
square41
s100
neos3025225
datt256
rmine15
energy2
nug08-3rd
test73
L1_sixm
rail4284
cont11
storm_1000
Primal2_1000
Linf_520c
set-cover
dlr1
heimdall
s82
nebula
energy1
gamora
thor
hulk
test93
test23
test43
test63
test83
test13
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using HiGHS-1.4.1 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of HiGHS-1.4.1
time ratios (log scale)
time of HiGHS-1.4.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
cont1
graph40-40
ns1687037
ex10
datt256
karted
square41
test33
neos5251015
degme
s100
fome13
neos3025225
a2864
test73
tpl-tub-ws
Primal2_1000
rail4284
energy1
shs1023
fhnw-bin1
rail02
storm_1000
energy2
test03
loki
test43
hulk
L1_sixm
L2CTA3D
thk_63
Dual2_5000
stat96v2
ns1688926
Linf_520c
thor
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using KNITRO-13.0.0 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of KNITRO-13.0.0
time ratios (log scale)
time of KNITRO-13.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
cont1
qap15
neos5251015
graph40-40
neos3
ex10
neos5052403
stat96v2
support10
karted
ns1687037
fome13
neos
rail02
psched3-3
bdry2
test73
scpm1
nug08-3rd
gamora
a2864
test13
test63
fhnw-bin1
dlr1
energy1
degme
test43
test83
L1_sixm
support19
L1_six1000
thk_48
test93
Linf_520c
thor
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using MATLAB-R2022b as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MATLAB-R2022b
time ratios (log scale)
time of MATLAB-R2022b
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔻
🔻
🔻
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔺
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔺
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
graph40-40
datt256
cont1
neos5251015
savsched1
woodlands09
neos
test53
fome13
energy2
braun
neos3
tpl-tub-ws
support10
ex10
test23
test93
degme
psched3-3
dlr1
energy1
groot
loki
test83
test43
test03
set-cover
fhnw-bin1
nug08-3rd
s82
support19
Dual2_5000
thk_48
L1_six1000
dlr2
thor
1/2048
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
5
10
2
5
100
2
5
1000
2
5
10k
2
click to hide/show
COPT-6.5.0
Gurobi-10.0.0
HiGHS-1.4.1
KNITRO-13.0.0
MATLAB-R2022b
MOSEK-10.0.25
ORTOOLS-9.6
Tulip-0.9.4
virtual best
LPfeas Benchmark (find PD feasible point)
shifted time ratios (shift=10 seconds) using Tulip-0.9.4 as base solver (24 Mar 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Tulip-0.9.4
time ratios (log scale)
time of Tulip-0.9.4
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark