🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
16_n14
i_n13
long15
netlarge2
netlarge6
square15
wide15
lo10
netlarge3
netlarge1
goto14_256_4
goto14_256_1
goto14_256_2
goto14_256_5
goto14_256_3
goto16_64_1
goto16_64_2
goto16_64_4
goto16_64_3
goto16_64_5
goto32_512_5
goto32_512_2
goto32_512_1
goto32_512_4
goto32_512_3
1
2
4
8
16
32
64
128
256
8
9
1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
100
2
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using virtual best as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
i_n13
long15
netlarge2
square15
wide15
16_n14
lo10
netlarge3
netlarge1
netlarge6
goto14_256_5
goto14_256_4
goto14_256_3
goto14_256_2
goto14_256_1
goto16_64_1
goto16_64_2
goto16_64_4
goto16_64_3
goto16_64_5
goto32_512_5
goto32_512_2
goto32_512_1
goto32_512_4
goto32_512_3
1/2
1
2
4
8
16
32
64
128
256
8
9
1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
100
2
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using OptVerse-0.7.0 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of OptVerse-0.7.0
time ratios (log scale)
time of OptVerse-0.7.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
16_n14
long15
netlarge2
netlarge6
square15
wide15
i_n13
lo10
netlarge3
netlarge1
goto14_256_4
goto14_256_1
goto14_256_2
goto14_256_5
goto14_256_3
goto16_64_2
goto16_64_5
goto16_64_1
goto16_64_3
goto16_64_4
goto32_512_2
goto32_512_1
goto32_512_4
goto32_512_5
goto32_512_3
1/2
1
2
4
8
16
32
64
128
256
7
8
9
1
2
3
4
5
6
7
8
9
10
2
3
4
5
6
7
8
9
100
2
3
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using MindOpt-1.0.0 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MindOpt-1.0.0
time ratios (log scale)
time of MindOpt-1.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
16_n14
i_n13
long15
wide15
lo10
square15
netlarge6
netlarge2
goto14_256_3
netlarge1
netlarge3
goto14_256_1
goto14_256_2
goto14_256_4
goto14_256_5
goto16_64_4
goto16_64_5
goto16_64_1
goto16_64_3
goto16_64_2
goto32_512_3
goto32_512_4
goto32_512_1
goto32_512_5
goto32_512_2
1/4
1/2
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using Gurobi-11.0.0 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Gurobi-11.0.0
time ratios (log scale)
time of Gurobi-11.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
long15
square15
wide15
i_n13
lo10
netlarge2
16_n14
netlarge3
netlarge1
netlarge6
goto14_256_4
goto14_256_1
goto14_256_5
goto14_256_2
goto14_256_3
goto16_64_2
goto16_64_3
goto16_64_1
goto16_64_4
goto16_64_5
goto32_512_2
goto32_512_1
goto32_512_5
goto32_512_4
goto32_512_3
1/4
1/2
1
2
4
8
16
32
64
128
256
1
2
5
10
2
5
100
2
5
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using COPT-7.0.0 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT-7.0.0
time ratios (log scale)
time of COPT-7.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
long15
square15
wide15
i_n13
16_n14
lo10
netlarge2
netlarge1
goto14_256_4
goto14_256_5
goto14_256_2
goto14_256_1
goto14_256_3
netlarge3
goto16_64_2
goto16_64_3
goto16_64_1
goto16_64_5
goto16_64_4
netlarge6
goto32_512_2
goto32_512_5
goto32_512_1
goto32_512_4
goto32_512_3
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
2
5
10
2
5
100
2
5
1000
2
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using Clp-1.17.7 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of Clp-1.17.7
time ratios (log scale)
time of Clp-1.17.7
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
lo10
netlarge2
long15
square15
wide15
16_n14
i_n13
netlarge3
netlarge1
netlarge6
goto14_256_2
goto14_256_4
goto14_256_1
goto14_256_5
goto14_256_3
goto16_64_2
goto16_64_3
goto16_64_1
goto16_64_4
goto16_64_5
goto32_512_1
goto32_512_2
goto32_512_3
goto32_512_4
goto32_512_5
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
2
5
10
2
5
100
2
5
1000
2
5
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using HiGHS-1.6.0 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of HiGHS-1.6.0
time ratios (log scale)
time of HiGHS-1.6.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
lo10
long15
square15
wide15
16_n14
netlarge2
i_n13
netlarge3
goto14_256_4
goto14_256_2
goto14_256_3
goto14_256_5
goto14_256_1
goto16_64_2
goto16_64_3
goto16_64_1
goto16_64_5
goto16_64_4
netlarge1
netlarge6
goto32_512_4
goto32_512_1
goto32_512_2
goto32_512_3
goto32_512_5
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
7
8
9
10
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using MATLAB-R2022b as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MATLAB-R2022b
time ratios (log scale)
time of MATLAB-R2022b
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
❌
❌
❌
🔺
🔺
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
🔻
16_n14
i_n13
lo10
goto14_256_4
goto14_256_2
goto14_256_5
goto14_256_1
goto14_256_3
netlarge6
goto16_64_1
netlarge1
wide15
long15
square15
goto16_64_5
goto16_64_3
goto16_64_2
goto16_64_4
netlarge2
netlarge3
goto32_512_5
goto32_512_4
goto32_512_1
goto32_512_2
goto32_512_3
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
7
8
9
10
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using MOSEK-10.1.9 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MOSEK-10.1.9
time ratios (log scale)
time of MOSEK-10.1.9
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
16_n14
lo10
i_n13
square15
long15
wide15
goto14_256_4
goto14_256_2
goto14_256_1
goto14_256_5
goto14_256_3
goto16_64_2
goto16_64_3
goto16_64_5
goto16_64_1
goto16_64_4
netlarge2
netlarge3
goto32_512_4
netlarge1
goto32_512_1
goto32_512_2
goto32_512_3
netlarge6
goto32_512_5
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
10
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using QSopt-1.01 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of QSopt-1.01
time ratios (log scale)
time of QSopt-1.01
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
16_n14
i_n13
wide15
long15
square15
lo10
goto14_256_4
goto14_256_5
goto14_256_2
goto14_256_1
goto14_256_3
goto16_64_2
goto16_64_1
goto16_64_4
goto16_64_3
goto16_64_5
netlarge3
goto32_512_4
netlarge2
netlarge1
goto32_512_1
goto32_512_2
goto32_512_3
netlarge6
goto32_512_5
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
click to hide/show
Clp-1.17.7
COPT-7.0.0
Gurobi-11.0.0
HiGHS-1.6.0
MATLAB-R2022b
MindOpt-1.0.0
MOSEK-10.1.9
OptVerse-0.7.0
QSopt-1.01
SOPLEX-6.0.0
virtual best
Large Network-LP Benchmark (commercial vs free)
shifted time ratios (shift=10 seconds) using SOPLEX-6.0.0 as base solver (4 Dec 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SOPLEX-6.0.0
time ratios (log scale)
time of SOPLEX-6.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark