🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
16_n14
i_n13
long15
netlarge2
square15
wide15
lo10
netlarge3
netlarge1
netlarge6
goto14_256_1
goto14_256_2
goto14_256_4
goto14_256_5
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_4
goto16_64_5
goto32_512_5
goto32_512_2
goto32_512_1
goto32_512_4
goto32_512_3
1
2
4
8
16
32
64
128
256
7
8
9
1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
100
2
3
4
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using virtual best as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
i_n13
long15
netlarge2
square15
wide15
16_n14
lo10
netlarge3
netlarge1
netlarge6
goto14_256_4
goto14_256_2
goto14_256_5
goto14_256_3
goto14_256_1
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_4
goto16_64_5
goto32_512_5
goto32_512_2
goto32_512_1
goto32_512_4
goto32_512_3
1/2
1
2
4
8
16
32
64
128
256
7
8
9
1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
100
2
3
4
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using OptVerse-0.2.6 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of OptVerse-0.2.6
time ratios (log scale)
time of OptVerse-0.2.6
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
16_n14
long15
netlarge2
square15
wide15
i_n13
lo10
netlarge3
netlarge1
netlarge6
goto14_256_1
goto14_256_2
goto14_256_4
goto14_256_5
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_5
goto16_64_4
goto32_512_2
goto32_512_5
goto32_512_1
goto32_512_4
goto32_512_3
1/2
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using MindOpt-0.18.5 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MindOpt-0.18.5
time ratios (log scale)
time of MindOpt-0.18.5
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
16_n14
i_n13
long15
wide15
lo10
square15
netlarge6
netlarge2
goto14_256_3
netlarge1
netlarge3
goto14_256_1
goto14_256_2
goto14_256_4
goto14_256_5
goto16_64_4
goto16_64_5
goto16_64_1
goto16_64_3
goto16_64_2
goto32_512_3
goto32_512_4
goto32_512_1
goto32_512_5
goto32_512_2
1/2
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using Gurobi-9.5.1 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-9.5.1
time ratios (log scale)
time of Gurobi-9.5.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
long15
netlarge2
square15
wide15
lo10
16_n14
i_n13
netlarge3
netlarge6
netlarge1
goto14_256_4
goto14_256_1
goto14_256_5
goto14_256_2
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_5
goto16_64_4
goto32_512_2
goto32_512_5
goto32_512_1
goto32_512_4
goto32_512_3
1/2
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using COPT-5.0.0 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT-5.0.0
time ratios (log scale)
time of COPT-5.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
long15
square15
wide15
i_n13
16_n14
lo10
netlarge2
netlarge1
goto14_256_4
goto14_256_5
goto14_256_2
goto14_256_1
goto14_256_3
netlarge3
goto16_64_2
goto16_64_3
goto16_64_1
goto16_64_5
goto16_64_4
netlarge6
goto32_512_2
goto32_512_5
goto32_512_1
goto32_512_4
goto32_512_3
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
2
5
10
2
5
100
2
5
1000
2
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using Clp-1.17.7 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Clp-1.17.7
time ratios (log scale)
time of Clp-1.17.7
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
lo10
netlarge2
square15
long15
wide15
16_n14
i_n13
netlarge3
netlarge1
netlarge6
goto14_256_2
goto14_256_4
goto14_256_5
goto14_256_1
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_4
goto16_64_5
goto32_512_1
goto32_512_2
goto32_512_3
goto32_512_4
goto32_512_5
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using HiGHS-1.1.1 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of HiGHS-1.1.1
time ratios (log scale)
time of HiGHS-1.1.1
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
lo10
long15
square15
wide15
16_n14
netlarge2
i_n13
netlarge3
goto14_256_4
goto14_256_2
goto14_256_3
goto14_256_5
goto14_256_1
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_4
goto16_64_5
netlarge1
netlarge6
goto32_512_4
goto32_512_1
goto32_512_2
goto32_512_3
goto32_512_5
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
7
8
9
10
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using MATLAB-R2020b as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MATLAB-R2020b
time ratios (log scale)
time of MATLAB-R2020b
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
16_n14
i_n13
netlarge6
goto14_256_4
lo10
goto14_256_5
goto14_256_1
goto14_256_2
netlarge1
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_3
goto16_64_5
goto16_64_4
long15
wide15
square15
netlarge2
netlarge3
goto32_512_4
goto32_512_2
goto32_512_3
goto32_512_5
goto32_512_1
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using MOSEK-9.3.6 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MOSEK-9.3.6
time ratios (log scale)
time of MOSEK-9.3.6
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
16_n14
lo10
i_n13
square15
long15
wide15
goto14_256_4
goto14_256_2
goto14_256_1
goto14_256_5
goto14_256_3
goto16_64_2
goto16_64_3
goto16_64_5
goto16_64_1
goto16_64_4
netlarge2
netlarge3
goto32_512_4
netlarge1
goto32_512_1
goto32_512_2
goto32_512_3
netlarge6
goto32_512_5
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
10
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using QSopt-1.01 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of QSopt-1.01
time ratios (log scale)
time of QSopt-1.01
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
16_n14
i_n13
wide15
long15
square15
lo10
goto14_256_4
goto14_256_5
goto14_256_2
goto14_256_1
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_4
goto16_64_3
goto16_64_5
netlarge3
goto32_512_4
netlarge2
netlarge1
goto32_512_1
goto32_512_2
goto32_512_3
netlarge6
goto32_512_5
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
click to hide/show
Clp-1.17.7
COPT-5.0.0
Gurobi-9.5.1
HiGHS-1.1.1
MATLAB-R2020b
MindOpt-0.18.5
MOSEK-9.3.6
OptVerse-0.2.6
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using SOPLEX-6.0.0 as base solver (17 Aug 2022) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SOPLEX-6.0.0
time ratios (log scale)
time of SOPLEX-6.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark