Solver Square Comparison: Considers all models.
| Date / Time: |
07/15/03 14:20:21 |
Solver comparison utility.
Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded,
fail) of one solver with all return outcomes of another solver. Interrupt
denotes resource or iteration limit has been reached.
Solver SolverA is represented on the left (rows) and
solver SolverB on top (columns).
See the solver return definitions for return codes.
Models having trace data only in one trace file are listed in
the "no data" column of the other.
| Tracefile 1 : | A.trc |
| Tracefile 2 : | B.trc |
| Solvers used : | SolverA |
| SolverB |
| Modeltype(s) |   LP |
|
optimal |
locally optimal |
feasible |
infeasible |
unbounded |
fail |
no data |
total SolverA |
| optimal | 73 |
- |
- |
- |
- |
- |
- |
73 |
| locally optimal | - |
- |
- |
- |
- |
- |
- |
- |
| feasible | - |
- |
- |
- |
- |
- |
- |
- |
| infeasible | - |
- |
- |
2 |
- |
- |
- |
2 |
| unbounded | - |
- |
- |
- |
- |
- |
- |
- |
| fail | - |
- |
- |
- |
- |
2 |
- |
2 |
| no data | - |
- |
- |
- |
- |
- |
- |
- |
| total SolverB |
73 |
- |
- |
2 |
- |
2 |
- |
77 |
| Outcome | Model Status | Solver Status |
| optimal | 1 or 15 | 1 |
| locally optimal | 2 | 1 |
| feasible | 7 or 16 or 17 | 1 or 2 or 3 or 4 or 5 |
| infeasible | 4 or 5 or 19 | 1 |
| unbounded | 3 or 18 | 1 |
| fail | all other | all other |
Solver Resource Times
- Models for each solver pair outcome. Listed are the
solver resource times TIME(.) in seconds,
as well as the ratio RATIO(./.) of
resource times for the two solvers if both solved optimally.
- Also listed are the objective values OBJ(.) using both solvers.
The better solution found is listed in boldface. A solution
is considered better, if the relative objective function
difference is greater than
1.00E-05.
If both solutions are less than 1e-1, we use the absolute
difference.
- Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.
SolverA: optimal -- SolverB: optimal    Back to top
| Modelname |
Time(SolverA) |
Time(SolverB) |
Ratio (SolverA/SolverB) |
Obj (SolverA) |
Obj (SolverB) |
| aa01 |
15.5800 |
20.5900 |
0.757 |
55535.43638822 |
55535.43638822 |
| aa03 |
7.7000 |
9.3300 |
0.825 |
49616.36363636 |
49616.36363636 |
| air02 |
0.4800 |
0.5900 |
0.814 |
7640.00000000 |
7640.00000000 |
| air06 |
7.5800 |
9.1300 |
0.830 |
49616.36363636 |
49616.36363636 |
| baxter |
11.2200 |
7.6900 |
1.459 |
56007255.67225311 |
56007255.67225311 |
| car4 |
4.0400 |
5.1000 |
0.792 |
35.46037017 |
35.46037017 |
| cari |
0.4300 |
0.6600 |
0.652 |
581.89305779 |
581.89305779 |
| co5 |
16.9200 |
18.0400 |
0.938 |
714469.55375105 |
714469.55375105 |
| co9 |
103.1100 |
87.1200 |
1.184 |
946920.43028456 |
946920.43028963 |
| cq5 |
16.5900 |
13.9300 |
1.191 |
400133.80747262 |
400133.80747262 |
| cq9 |
77.0200 |
75.8500 |
1.015 |
505541.70980727 |
505541.70980727 |
| crew1 |
1.6800 |
2.1600 |
0.778 |
20.55555556 |
20.55555556 |
| ex3sta1 |
322.8300 |
79.8400 |
4.043 |
-63.07540325 |
-63.07540325 |
| fit2d |
3.8700 |
1.7700 |
2.186 |
-68464.29329383 |
-68464.29329383 |
| fit2p |
27.4700 |
46.0500 |
0.597 |
68464.29329383 |
68464.29329383 |
| fome11 |
1.4200 |
0.6600 |
2.152 |
0.00000000 |
0.00000000 |
| fome12 |
2.9100 |
1.4000 |
2.079 |
0.00000000 |
0.00000000 |
| gen1 |
1.7200 |
41.6600 |
0.041 |
0.00000000 |
0.00000000 |
| gen2 |
199.4800 |
217.6200 |
0.917 |
3.29279078 |
3.29279078 |
| gen4 |
19.1200 |
53.5200 |
0.357 |
0.00000000 |
0.00000000 |
| jendrec1 |
13.8800 |
15.7500 |
0.881 |
7028.46051135 |
7028.46051135 |
| ken-11 |
2.5600 |
2.2700 |
1.128 |
-6972382262.51997000 |
-6972382262.51997000 |
| ken-13 |
7.9200 |
7.3800 |
1.073 |
-1.0257394789482E+10 |
-1.0257394789482E+10 |
| l30 |
159.4900 |
82.3600 |
1.936 |
0.95266136 |
0.95266132 |
| lp22 |
249.1600 |
255.2000 |
0.976 |
458.94459411 |
458.94459411 |
| lpl3 |
15.5200 |
13.2500 |
1.171 |
27318.00000000 |
27318.00000000 |
| maros-r7 |
17.9900 |
23.0000 |
0.782 |
1497185.16647964 |
1497185.16647964 |
| mod2 |
33.4100 |
40.1800 |
0.832 |
27737371.36444540 |
27737371.36442230 |
| model10 |
113.5700 |
144.5900 |
0.785 |
-154599.62130064 |
-154599.62127545 |
| model11 |
6.8500 |
5.0100 |
1.367 |
0.00000000 |
0.00000000 |
| model5 |
25.0500 |
18.7700 |
1.335 |
-858440.72907343 |
-858440.72907343 |
| model7 |
36.4000 |
16.1800 |
2.250 |
49380.08549293 |
49380.08551359 |
| model9 |
7.8600 |
7.6800 |
1.023 |
-141123.09361329 |
-141123.09360573 |
| nemspmm1 |
26.5000 |
24.0000 |
1.104 |
-327415.83567076 |
-327415.83567076 |
| nemspmm2 |
28.4000 |
28.9500 |
0.981 |
-291794.83608908 |
-291794.83608908 |
| nemswrld |
667.9100 |
427.1700 |
1.564 |
260.30896600 |
260.30896601 |
| nsir1 |
0.9800 |
1.9600 |
0.500 |
-28909033.00000000 |
-28909033.00000000 |
| nsir2 |
1.7900 |
2.6000 |
0.688 |
-27175593.50000000 |
-27175593.50000000 |
| osa-07 |
2.8100 |
1.0400 |
2.702 |
535722.51729935 |
535722.51729935 |
| p010 |
12.9000 |
22.4400 |
0.575 |
1115047.91511082 |
1115047.91511082 |
| p05 |
4.1300 |
6.5400 |
0.631 |
556000.27662588 |
556000.27662588 |
| pcb3000 |
7.4600 |
8.6800 |
0.859 |
137416.41961282 |
137416.41961282 |
| pds-06 |
3.3700 |
2.1100 |
1.597 |
27761037600.00001000 |
27761037600.00001000 |
| pds-10 |
9.5600 |
6.9800 |
1.370 |
26727094976.00000000 |
26727094976.00000000 |
| pilot87 |
140.7400 |
113.4300 |
1.241 |
301.71034733 |
301.71122574 |
| pltexpa3_16 |
3.0000 |
0.9100 |
3.297 |
0.00000000 |
0.00000000 |
| pltexpa4_6 |
2.8300 |
0.8300 |
3.410 |
0.00000000 |
0.00000000 |
| r05 |
6.0600 |
6.3800 |
0.950 |
557831.85904066 |
557831.85904066 |
| rat1 |
2.8100 |
2.8900 |
0.972 |
1999531.66287928 |
1999531.66287928 |
| rat5 |
10.6000 |
12.7900 |
0.829 |
3083707.01043843 |
3083707.01043841 |
| rosen10 |
1.8300 |
1.8500 |
0.989 |
-174215.45613870 |
-174215.45613870 |
| sc205-2r-1600 |
30.3300 |
5.9700 |
5.080 |
0.00000000 |
0.00000000 |
| scagr7-2r-432 |
4.0600 |
1.6100 |
2.522 |
-834029.77379419 |
-834029.78024267 |
| scagr7-2r-864 |
16.3200 |
4.4000 |
3.709 |
-834376.09905847 |
-834376.09905846 |
| scfxm1-2b-64 |
24.1900 |
46.4600 |
0.521 |
2877.56386371 |
2877.56386371 |
| scfxm1-2r-128 |
24.8100 |
42.1700 |
0.588 |
2891.70611371 |
2891.70611371 |
| scfxm1-2r-64 |
7.6400 |
12.7000 |
0.602 |
2877.56386371 |
2877.56386371 |
| scfxm1-2r-96 |
13.7100 |
27.5300 |
0.498 |
2891.70611371 |
2891.70611371 |
| scrs8-2r-512 |
1.3300 |
0.6300 |
2.111 |
1074.09934157 |
1074.09934157 |
| scsd8-2b-64 |
2.0000 |
1.9900 |
1.005 |
15.99866803 |
15.99866803 |
| scsd8-2c-64 |
2.0500 |
1.9700 |
1.041 |
14.99923200 |
14.99923200 |
| scsd8-2r-108 |
0.8300 |
0.5900 |
1.407 |
23.69999446 |
23.69999670 |
| scsd8-2r-216 |
2.0800 |
1.3700 |
1.518 |
23.39998388 |
23.39998856 |
| sctap1-2b-64 |
2.6800 |
1.8000 |
1.489 |
484.56000000 |
484.56000000 |
| sctap1-2r-216 |
1.8600 |
1.4600 |
1.274 |
249.00000000 |
249.00000000 |
| slptsk |
7.7600 |
47.2800 |
0.164 |
29.89536602 |
29.89536602 |
| south31 |
464.4500 |
161.6800 |
2.873 |
1818940197.10106000 |
1818940197.10106000 |
| stocfor3 |
13.2400 |
12.4800 |
1.061 |
-39976.78394365 |
-39976.78394365 |
| stormg2-27 |
5.8500 |
7.2400 |
0.808 |
15508983.20550720 |
15508983.20550720 |
| testbig |
8.5600 |
2.2500 |
3.804 |
-60.42296073 |
-60.42296073 |
| ulevimin |
292.6900 |
176.6900 |
1.657 |
-5191101861.43197000 |
-5191101861.43200000 |
| wood1p |
0.4100 |
0.4500 |
0.911 |
1.44290241 |
1.44290241 |
| world |
31.9800 |
39.6300 |
0.807 |
40364873.11417660 |
40364873.11415060 |
Back to top
SolverA: infeasible -- SolverB: infeasible    Back to top
| Modelname |
Time(SolverA) |
Time(SolverB) |
Ratio (SolverA/SolverB) |
Status (SolverA) |
Status (SolverB) |
| bgindy |
0.4100 |
1.2100 |
--- |
mstat(19) sstat( 1) |
mstat( 4) sstat( 1) |
| gosh |
0.5800 |
5.8100 |
--- |
mstat(19) sstat( 1) |
mstat( 4) sstat( 1) |
Back to top
SolverA: fail -- SolverB: fail    Back to top
| Modelname |
Time(SolverA) |
Time(SolverB) |
Ratio (SolverA/SolverB) |
Status (SolverA) |
Status (SolverB) |
| nug15 |
910.6700 |
899.7600 |
--- |
mstat( 6) sstat( 3) |
mstat( 6) sstat( 3) |
| qap15 |
912.3400 |
902.5000 |
--- |
mstat( 6) sstat( 3) |
mstat( 6) sstat( 3) |
Back to top
SolverA: optimal:     Back to top
| Modelname |
Time(SolverA) |
Obj (SolverA) |
| aa01 |
15.5800 |
55535.43638822 |
| aa03 |
7.7000 |
49616.36363636 |
| air02 |
0.4800 |
7640.00000000 |
| air06 |
7.5800 |
49616.36363636 |
| baxter |
11.2200 |
56007255.67225311 |
| car4 |
4.0400 |
35.46037017 |
| cari |
0.4300 |
581.89305779 |
| co5 |
16.9200 |
714469.55375105 |
| co9 |
103.1100 |
946920.43028456 |
| cq5 |
16.5900 |
400133.80747262 |
| cq9 |
77.0200 |
505541.70980727 |
| crew1 |
1.6800 |
20.55555556 |
| ex3sta1 |
322.8300 |
-63.07540325 |
| fit2d |
3.8700 |
-68464.29329383 |
| fit2p |
27.4700 |
68464.29329383 |
| fome11 |
1.4200 |
0.00000000 |
| fome12 |
2.9100 |
0.00000000 |
| gen1 |
1.7200 |
0.00000000 |
| gen2 |
199.4800 |
3.29279078 |
| gen4 |
19.1200 |
0.00000000 |
| jendrec1 |
13.8800 |
7028.46051135 |
| ken-11 |
2.5600 |
-6972382262.51997000 |
| ken-13 |
7.9200 |
-1.0257394789482E+10 |
| l30 |
159.4900 |
0.95266136 |
| lp22 |
249.1600 |
458.94459411 |
| lpl3 |
15.5200 |
27318.00000000 |
| maros-r7 |
17.9900 |
1497185.16647964 |
| mod2 |
33.4100 |
27737371.36444540 |
| model10 |
113.5700 |
-154599.62130064 |
| model11 |
6.8500 |
0.00000000 |
| model5 |
25.0500 |
-858440.72907343 |
| model7 |
36.4000 |
49380.08549293 |
| model9 |
7.8600 |
-141123.09361329 |
| nemspmm1 |
26.5000 |
-327415.83567076 |
| nemspmm2 |
28.4000 |
-291794.83608908 |
| nemswrld |
667.9100 |
260.30896600 |
| nsir1 |
0.9800 |
-28909033.00000000 |
| nsir2 |
1.7900 |
-27175593.50000000 |
| osa-07 |
2.8100 |
535722.51729935 |
| p010 |
12.9000 |
1115047.91511082 |
| p05 |
4.1300 |
556000.27662588 |
| pcb3000 |
7.4600 |
137416.41961282 |
| pds-06 |
3.3700 |
27761037600.00001000 |
| pds-10 |
9.5600 |
26727094976.00000000 |
| pilot87 |
140.7400 |
301.71034733 |
| pltexpa3_16 |
3.0000 |
0.00000000 |
| pltexpa4_6 |
2.8300 |
0.00000000 |
| r05 |
6.0600 |
557831.85904066 |
| rat1 |
2.8100 |
1999531.66287928 |
| rat5 |
10.6000 |
3083707.01043843 |
| rosen10 |
1.8300 |
-174215.45613870 |
| sc205-2r-1600 |
30.3300 |
0.00000000 |
| scagr7-2r-432 |
4.0600 |
-834029.77379419 |
| scagr7-2r-864 |
16.3200 |
-834376.09905847 |
| scfxm1-2b-64 |
24.1900 |
2877.56386371 |
| scfxm1-2r-128 |
24.8100 |
2891.70611371 |
| scfxm1-2r-64 |
7.6400 |
2877.56386371 |
| scfxm1-2r-96 |
13.7100 |
2891.70611371 |
| scrs8-2r-512 |
1.3300 |
1074.09934157 |
| scsd8-2b-64 |
2.0000 |
15.99866803 |
| scsd8-2c-64 |
2.0500 |
14.99923200 |
| scsd8-2r-108 |
0.8300 |
23.69999446 |
| scsd8-2r-216 |
2.0800 |
23.39998388 |
| sctap1-2b-64 |
2.6800 |
484.56000000 |
| sctap1-2r-216 |
1.8600 |
249.00000000 |
| slptsk |
7.7600 |
29.89536602 |
| south31 |
464.4500 |
1818940197.10106000 |
| stocfor3 |
13.2400 |
-39976.78394365 |
| stormg2-27 |
5.8500 |
15508983.20550720 |
| testbig |
8.5600 |
-60.42296073 |
| ulevimin |
292.6900 |
-5191101861.43197000 |
| wood1p |
0.4100 |
1.44290241 |
| world |
31.9800 |
40364873.11417660 |
Back to top
SolverA: infeasible:     Back to top
| Modelname |
Time(SolverA) |
Status (SolverA) |
| bgindy |
-- |
mstat(19) sstat( 1) |
| gosh |
-- |
mstat(19) sstat( 1) |
Back to top
SolverA: fail:     Back to top
| Modelname |
Time(SolverA) |
Status (SolverA) |
| nug15 |
-- |
mstat( 6) sstat( 3) |
| qap15 |
-- |
mstat( 6) sstat( 3) |
Back to top
SolverB: optimal:     Back to top
| Modelname |
Time(SolverB) |
Obj (SolverB) |
| aa01 |
20.5900 |
55535.43638822 |
| aa03 |
9.3300 |
49616.36363636 |
| air02 |
0.5900 |
7640.00000000 |
| air06 |
9.1300 |
49616.36363636 |
| baxter |
7.6900 |
56007255.67225311 |
| car4 |
5.1000 |
35.46037017 |
| cari |
0.6600 |
581.89305779 |
| co5 |
18.0400 |
714469.55375105 |
| co9 |
87.1200 |
946920.43028963 |
| cq5 |
13.9300 |
400133.80747262 |
| cq9 |
75.8500 |
505541.70980727 |
| crew1 |
2.1600 |
20.55555556 |
| ex3sta1 |
79.8400 |
-63.07540325 |
| fit2d |
1.7700 |
-68464.29329383 |
| fit2p |
46.0500 |
68464.29329383 |
| fome11 |
0.6600 |
0.00000000 |
| fome12 |
1.4000 |
0.00000000 |
| gen1 |
41.6600 |
0.00000000 |
| gen2 |
217.6200 |
3.29279078 |
| gen4 |
53.5200 |
0.00000000 |
| jendrec1 |
15.7500 |
7028.46051135 |
| ken-11 |
2.2700 |
-6972382262.51997000 |
| ken-13 |
7.3800 |
-1.0257394789482E+10 |
| l30 |
82.3600 |
0.95266132 |
| lp22 |
255.2000 |
458.94459411 |
| lpl3 |
13.2500 |
27318.00000000 |
| maros-r7 |
23.0000 |
1497185.16647964 |
| mod2 |
40.1800 |
27737371.36442230 |
| model10 |
144.5900 |
-154599.62127545 |
| model11 |
5.0100 |
0.00000000 |
| model5 |
18.7700 |
-858440.72907343 |
| model7 |
16.1800 |
49380.08551359 |
| model9 |
7.6800 |
-141123.09360573 |
| nemspmm1 |
24.0000 |
-327415.83567076 |
| nemspmm2 |
28.9500 |
-291794.83608908 |
| nemswrld |
427.1700 |
260.30896601 |
| nsir1 |
1.9600 |
-28909033.00000000 |
| nsir2 |
2.6000 |
-27175593.50000000 |
| osa-07 |
1.0400 |
535722.51729935 |
| p010 |
22.4400 |
1115047.91511082 |
| p05 |
6.5400 |
556000.27662588 |
| pcb3000 |
8.6800 |
137416.41961282 |
| pds-06 |
2.1100 |
27761037600.00001000 |
| pds-10 |
6.9800 |
26727094976.00000000 |
| pilot87 |
113.4300 |
301.71122574 |
| pltexpa3_16 |
0.9100 |
0.00000000 |
| pltexpa4_6 |
0.8300 |
0.00000000 |
| r05 |
6.3800 |
557831.85904066 |
| rat1 |
2.8900 |
1999531.66287928 |
| rat5 |
12.7900 |
3083707.01043841 |
| rosen10 |
1.8500 |
-174215.45613870 |
| sc205-2r-1600 |
5.9700 |
0.00000000 |
| scagr7-2r-432 |
1.6100 |
-834029.78024267 |
| scagr7-2r-864 |
4.4000 |
-834376.09905846 |
| scfxm1-2b-64 |
46.4600 |
2877.56386371 |
| scfxm1-2r-128 |
42.1700 |
2891.70611371 |
| scfxm1-2r-64 |
12.7000 |
2877.56386371 |
| scfxm1-2r-96 |
27.5300 |
2891.70611371 |
| scrs8-2r-512 |
0.6300 |
1074.09934157 |
| scsd8-2b-64 |
1.9900 |
15.99866803 |
| scsd8-2c-64 |
1.9700 |
14.99923200 |
| scsd8-2r-108 |
0.5900 |
23.69999670 |
| scsd8-2r-216 |
1.3700 |
23.39998856 |
| sctap1-2b-64 |
1.8000 |
484.56000000 |
| sctap1-2r-216 |
1.4600 |
249.00000000 |
| slptsk |
47.2800 |
29.89536602 |
| south31 |
161.6800 |
1818940197.10106000 |
| stocfor3 |
12.4800 |
-39976.78394365 |
| stormg2-27 |
7.2400 |
15508983.20550720 |
| testbig |
2.2500 |
-60.42296073 |
| ulevimin |
176.6900 |
-5191101861.43200000 |
| wood1p |
0.4500 |
1.44290241 |
| world |
39.6300 |
40364873.11415060 |
Back to top
SolverB: infeasible:     Back to top
| Modelname |
Time(SolverB) |
Status (SolverB) |
| bgindy |
-- |
mstat( 4) sstat( 1) |
| gosh |
-- |
mstat( 4) sstat( 1) |
Back to top
SolverB: fail:     Back to top
| Modelname |
Time(SolverB) |
Status (SolverB) |
| nug15 |
-- |
mstat( 6) sstat( 3) |
| qap15 |
-- |
mstat( 6) sstat( 3) |
Back to top