🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
ns2082847
ns2844866
ns2394796
ns2494475
ns2081729
ns3134812
ns2382816
chrom_256
ns2017839
ns2441809
ns1952667
chrom_512
bc
neos-849702
ns43503
u30t24ramp
chrom_1024
ns1954122
ns5013590
u40t24wc
ns2034125
ns3974959
u50t24wc
ns3633010
ns2996139
ns1943024
ns476799
ns2319914
ns4228793
ns2071214
ns2326618
ns2319318
ns4636843
ns3555904
ns2369235
ns2070961
ns3360030
ns2267839
ns29903
u40t24ramp
ns4976508
ns2164569
ns2350781
ns4165869
ns3337549
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using virtual best as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of virtual best
time ratios (log scale)
time of virtual best
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
ns2082847
ns2844866
ns2394796
ns2494475
ns2081729
ns3134812
ns2382816
chrom_256
ns2017839
ns2441809
chrom_512
bc
ns1952667
neos-849702
ns43503
u30t24ramp
u40t24wc
ns2034125
chrom_1024
ns3974959
u50t24wc
ns5013590
ns1954122
ns3633010
ns1943024
ns476799
ns4228793
ns2071214
ns2319914
ns2319318
ns3555904
ns2369235
ns2070961
ns2996139
ns2267839
ns2326618
ns29903
u40t24ramp
ns3360030
ns4976508
ns2164569
ns4636843
ns4165869
ns2350781
ns3337549
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using GUROBI-10.0.0 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of GUROBI-10.0.0
time ratios (log scale)
time of GUROBI-10.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns2082847
ns2494475
ns2394796
chrom_256
ns1952667
ns2017839
ns2081729
chrom_512
chrom_1024
ns1954122
ns5013590
ns43503
ns2034125
neos-849702
ns2382816
u30t24ramp
u40t24wc
ns2326618
ns4636843
ns3555904
bc
ns3360030
ns1943024
ns4228793
ns2369235
u50t24wc
ns29903
ns2071214
ns3633010
ns3134812
ns2319318
ns2319914
ns2996139
ns2267839
ns4165869
ns2164569
ns3337549
ns2844866
ns3974959
ns2441809
ns476799
ns4976508
ns2070961
u40t24ramp
ns2350781
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using COPT-6.5.0 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of COPT-6.5.0
time ratios (log scale)
time of COPT-6.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
ns2082847
ns2996139
ns2017839
ns2394796
ns43503
u30t24ramp
chrom_256
ns2494475
u40t24wc
ns2382816
u50t24wc
bc
neos-849702
ns2319914
ns3974959
u40t24ramp
ns2441809
ns1943024
ns1952667
ns3360030
ns2034125
ns1954122
ns2319318
ns3134812
ns4636843
ns2350781
ns2164569
chrom_512
ns5013590
ns4976508
ns476799
chrom_1024
ns4228793
ns2369235
ns4165869
ns3633010
ns3555904
ns2326618
ns3337549
ns2081729
ns2070961
ns29903
ns2844866
ns2267839
ns2071214
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using HiGHS-1.5.0 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of HiGHS-1.5.0
time ratios (log scale)
time of HiGHS-1.5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
ns2494475
chrom_256
ns2394796
ns2319914
chrom_512
ns2017839
ns43503
bc
neos-849702
u30t24ramp
chrom_1024
ns2996139
ns2071214
ns2319318
ns2441809
ns2350781
u40t24ramp
ns2382816
ns4636843
ns3633010
ns3134812
ns29903
ns5013590
ns3555904
ns4228793
ns4165869
ns476799
ns4976508
ns3974959
ns3360030
ns1952667
ns1954122
ns2844866
u40t24wc
ns2369235
ns2326618
ns1943024
ns2267839
ns2164569
ns2082847
ns2081729
ns2070961
ns2034125
ns3337549
u50t24wc
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
3
4
5
6
7
8
9
100
2
3
4
5
6
7
8
9
1000
2
3
4
5
6
7
8
9
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using SCIPC-8.0.0 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIPC-8.0.0
time ratios (log scale)
time of SCIPC-8.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔺
🔺
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔺
🔺
🔺
❌
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔺
🔺
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns2494475
ns2394796
chrom_256
neos-849702
ns2996139
bc
u30t24ramp
ns2017839
chrom_512
ns43503
ns3134812
ns2319914
chrom_1024
ns476799
ns4636843
ns2382816
ns1952667
ns2441809
ns2071214
ns3337549
ns3360030
ns3555904
ns4976508
ns4165869
u40t24ramp
ns4228793
ns5013590
ns3974959
ns3633010
ns2844866
ns1943024
u40t24wc
ns2369235
ns2350781
ns2326618
ns2319318
ns2267839
ns2164569
ns2082847
ns2081729
ns2070961
ns2034125
ns1954122
ns29903
u50t24wc
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using SCIP-8.0.0 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of SCIP-8.0.0
time ratios (log scale)
time of SCIP-8.0.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔺
🔻
❌
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔺
🔺
🔺
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
🔻
❌
🔻
❌
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns2082847
ns1954122
ns2319914
ns2996139
ns2164569
bc
ns29903
ns3134812
ns3337549
ns3360030
ns3555904
ns3633010
ns3974959
ns4165869
ns4228793
ns43503
ns4636843
ns476799
ns4976508
ns5013590
u30t24ramp
u40t24ramp
ns2844866
ns2494475
ns2394796
u40t24wc
chrom_256
chrom_512
chrom_1024
neos-849702
ns1943024
ns1952667
ns2017839
ns2034125
ns2070961
ns2071214
ns2081729
ns2267839
ns2319318
ns2326618
ns2350781
ns2369235
ns2382816
ns2441809
u50t24wc
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using CBC-2.10.7 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of CBC-2.10.7
time ratios (log scale)
time of CBC-2.10.7
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
🔺
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
🔺
🔺
🔺
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔺
🔺
🔺
🔻
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔺
🔺
🔺
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
❌
🔻
🔻
❌
❌
❌
🔻
❌
🔻
❌
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns2082847
ns1952667
ns2017839
ns1954122
ns2319318
ns2319914
bc
ns2996139
ns3134812
ns3337549
ns3360030
ns3555904
ns3633010
ns3974959
ns4165869
ns4228793
ns43503
ns4636843
ns476799
ns4976508
ns5013590
u30t24ramp
u40t24ramp
ns29903
ns2844866
ns2394796
ns2441809
chrom_256
chrom_512
chrom_1024
neos-849702
ns1943024
ns2034125
ns2070961
ns2494475
ns2071214
ns2164569
ns2267839
ns2326618
ns2350781
ns2369235
ns2382816
u40t24wc
ns2081729
u50t24wc
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
2048
1
2
5
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using GLPK-5.0 as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of GLPK-5.0
time ratios (log scale)
time of GLPK-5.0
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark
🔺
🔺
❌
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
🔻
❌
❌
❌
❌
❌
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔺
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
❌
🔻
🔻
❌
❌
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
❌
🔻
❌
❌
🔻
❌
🔻
🔻
❌
❌
❌
🔻
🔻
❌
🔻
🔻
🔻
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
❌
❌
❌
❌
🔻
🔺
🔺
🔻
❌
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
🔻
🔻
🔻
❌
❌
🔻
❌
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
❌
❌
🔻
❌
🔺
🔻
❌
🔻
🔻
🔻
❌
❌
❌
🔻
❌
❌
🔻
🔻
❌
❌
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
❌
❌
🔻
❌
❌
❌
❌
❌
❌
❌
🔻
❌
🔻
❌
🔻
❌
🔻
🔻
🔻
🔻
🔻
❌
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
🔻
ns2494475
ns1954122
ns2319318
bc
ns2844866
ns29903
ns2996139
ns3134812
ns3337549
ns3360030
ns3555904
ns3633010
ns3974959
ns4228793
ns43503
ns4636843
ns476799
ns4976508
ns5013590
u30t24ramp
u40t24ramp
ns4165869
ns2441809
ns2394796
ns2382816
chrom_256
chrom_512
chrom_1024
neos-849702
ns1943024
ns1952667
ns2017839
ns2034125
u40t24wc
ns2070961
ns2081729
ns2082847
ns2164569
ns2267839
ns2319914
ns2326618
ns2350781
ns2369235
ns2071214
u50t24wc
1/1024
1/512
1/256
1/128
1/64
1/32
1/16
1/8
1/4
1/2
1
2
4
8
16
32
64
128
256
512
1024
10
2
5
100
2
5
1000
2
5
10k
click to hide/show
CBC-2.10.7
COPT-6.5.0
GLPK-5.0
GUROBI-10.0.0
HiGHS-1.5.0
MATLAB-2020a
SCIP-8.0.0
SCIPC-8.0.0
virtual best
MILP cases that are slightly pathological
shifted time ratios (shift=10 seconds) using MATLAB-2020a as base solver (9 Apr 2023) -
mattmilten.github.io/mittelmann-plots
instances sorted by solving time of MATLAB-2020a
time ratios (log scale)
time of MATLAB-2020a
(🔻)🔺: (base) solver failed to solve within the time limit
❌: no solution
plotly-logomark