Solver Square Comparison

Solver Square Comparison: Considers all models.

Date / Time: 06/24/04 14:36:31

Solver comparison utility.

Compares all solver return outcomes (for example optimal, locally optimal, infeasible, unbounded, fail) of one solver with all return outcomes of another solver. Interrupt denotes resource or iteration limit has been reached. Solver AMPL/IPOPT is represented on the left (rows) and solver SNOPT on top (columns). See the solver return definitions for return codes.

Models having trace data only in one trace file are listed in the "no data" column of the other.

Tracefile 1 :	`3-cops_ipopt.trc`
Tracefile 2 :	`4-cops_snopt.trc`
Solvers used :	`AMPL/IPOPT`
	`SNOPT`
Modeltype(s)	`NLP`

	SNOPT: optimal	SNOPT: locally optimal	SNOPT: feasible	SNOPT: infeasible	SNOPT: unbounded	SNOPT: fail	SNOPT: no data	total AMPL/IPOPT
AMPL/IPOPT: optimal	-	-	-	-	-	-	-	`-`
AMPL/IPOPT: locally optimal	-	`34`	`8`	-	-	`1`	-	`43`
AMPL/IPOPT: feasible	-	-	-	-	-	-	-	`-`
AMPL/IPOPT: infeasible	-	-	-	-	-	-	-	`-`
AMPL/IPOPT: unbounded	-	-	-	-	-	-	-	`-`
AMPL/IPOPT: fail	-	`21`	-	-	-	-	-	`21`
AMPL/IPOPT: no data	-	-	-	-	-	-	-	`-`
total SNOPT	`-`	`55`	`8`	`-`	`-`	`1`	`-`	`64`

Solver return definitions:

Outcome	Model Status	Solver Status
optimal	1 or 15	1
locally optimal	2	any
feasible	7 or 16 or 17	1 or 2 or 3 or 4 or 5
infeasible	4 or 5 or 19	1
unbounded	3 or 18	1
fail	all other	all other

Solver Resource Times

Models for each solver pair outcome. Listed are the solver resource times TIME(.) in seconds, as well as the ratio RATIO(./.) of resource times for the two solvers if both solved optimally.
Also listed are the objective values OBJ(.) using both solvers. The better solution found is listed in boldface. A solution is considered better, if the relative objective function difference is greater than 1.00E-05. If both solutions are less than 1e-1, we use the absolute difference.
Solver resource time ratios for a particular model are listed only if one solver has resource greater than 5.00E-02.

AMPL/IPOPT: locally optimal -- SNOPT: locally optimal Back to top

Modelname	Time (AMPL/IPOPT)	Time (SNOPT)	Ratio (AMPL/IPOPT/SNOPT)	Obj (AMPL/IPOPT)	Obj (SNOPT)
`camshape100`	`0.2600`	`0.2021`	`1.287`	`-4.28414700`	`-4.28411473`
`camshape200`	`3.1200`	`0.5613`	`5.559`	`-4.27850000`	`-4.27844288`
`camshape400`	`5.5200`	`2.3875`	`2.312`	`-4.27568700`	`-4.27567050`
`camshape800`	`4.9300`	`10.4830`	`0.470`	`-4.27427200`	`-4.26882831`
`catmix100`	`0.6700`	`0.9430`	`0.710`	`-0.04806930`	`-0.04805960`
`catmix200`	`4.5300`	`4.1085`	`1.103`	`-0.04805893`	`-0.04804863`
`catmix400`	`4.2100`	`16.9614`	`0.248`	`-0.04805617`	`-0.04804385`
`catmix800`	`6.8900`	`45.8012`	`0.150`	`-0.04805512`	`-0.04769665`
`elec25`	`5.9200`	`1.6156`	`3.664`	`244.40240000`	`243.81276030`
`gasoil100`	`2.0300`	`11.4082`	`0.178`	`0.00523659`	`0.00523659`
`gasoil200`	`5.1100`	`51.2104`	`0.100`	`0.00523660`	`0.00523660`
`gasoil400`	`14.1700`	`184.5658`	`0.077`	`0.00523660`	`0.00523660`
`gasoil50`	`0.8800`	`4.0092`	`0.219`	`0.00523664`	`0.00523664`
`jbearing25`	`1.4400`	`1682.6603`	`0.001`	`-0.15482210`	`-0.15482422`
`jbearing50`	`1.4400`	`1676.3090`	`0.001`	`-0.15482210`	`-0.15482422`
`lnts100`	`0.3200`	`2.9824`	`0.107`	`0.55459540`	`0.55459616`
`lnts200`	`1.0800`	`12.0809`	`0.089`	`0.55457700`	`0.55457719`
`lnts400`	`1.3200`	`40.0331`	`0.033`	`0.55457240`	`0.55457260`
`lnts50`	`0.1500`	`0.8985`	`0.167`	`0.55466880`	`0.55466877`
`methanol100`	`6.6900`	`15.8370`	`0.422`	`0.00902229`	`0.00902229`
`methanol200`	`5.5600`	`66.1694`	`0.084`	`0.00902229`	`0.00902229`
`methanol400`	`12.7600`	`231.1582`	`0.055`	`0.00902229`	`0.00902229`
`methanol50`	`1.2200`	`4.5836`	`0.266`	`0.00902229`	`0.00902229`
`minsurf25`	`2.2800`	`32.9513`	`0.069`	`2.51948900`	`2.51948768`
`pinene100`	`249.3000`	`38.5003`	`6.475`	`19.87217000`	`19.87217015`
`polygon75`	`100.9800`	`21.0867`	`4.789`	`-0.73723350`	`0.78476976`
`popdynm50`	`253.6000`	`12.5029`	`20.283`	`19746550.00000000`	`19746545.15628000`
`rocket100`	`6.7500`	`9.5687`	`0.705`	`-1.01283200`	`-1.01281060`
`rocket200`	`25.9700`	`21.3875`	`1.214`	`-1.01283500`	`-1.01267680`
`rocket400`	`138.4000`	`97.0642`	`1.426`	`-1.01283500`	`-1.01127925`
`rocket50`	`7.0600`	`3.0099`	`2.346`	`-1.01281700`	`-1.01280636`
`torsion25`	`2.3400`	`26.7392`	`0.088`	`-0.41750980`	`-0.41751073`
`torsion50`	`4.9600`	`370.4744`	`0.013`	`-0.41808570`	`-0.41808761`
`torsion75`	`10.5900`	`1614.0668`	`0.007`	`-0.41819660`	`-0.41819939`

AMPL/IPOPT: locally optimal -- SNOPT: feasible Back to top

Modelname	Time (AMPL/IPOPT)	Time (SNOPT)	Ratio (AMPL/IPOPT/SNOPT)	Obj (AMPL/IPOPT)	Obj (SNOPT)
`jbearing75`	`2.5300`	`3600.3621`	`0.001`	`-0.15498130`	`-0.11165267`
`minsurf100`	`50.8500`	`3602.0874`	`0.014`	`2.50695100`	`2.51369838`
`minsurf50`	`12.4900`	`3600.5754`	`0.003`	`2.51489100`	`2.51532033`
`minsurf75`	`20.1100`	`3600.5146`	`0.006`	`2.50568800`	`2.51143788`
`pinene200`	`5.9100`	`133.1218`	`0.044`	`19.87217000`	`19.87216684`
`pinene25`	`3.5300`	`9.1851`	`0.384`	`19.87217000`	`19.87216553`
`pinene50`	`3.6300`	`9.1420`	`0.397`	`19.87217000`	`19.87216553`
`torsion100`	`21.2700`	`3600.7263`	`0.006`	`-0.41823540`	`-0.41823749`

AMPL/IPOPT: locally optimal -- SNOPT: fail Back to top

Modelname	Time (AMPL/IPOPT)	Time (SNOPT)	Ratio (AMPL/IPOPT/SNOPT)	Obj (AMPL/IPOPT)	Status (SNOPT)
`jbearing100`	`3.6900`	`0.0000`	---	`-0.15503780`	`mstat(13) sstat(13)`

AMPL/IPOPT: fail -- SNOPT: locally optimal Back to top

Modelname	Time (AMPL/IPOPT)	Time (SNOPT)	Ratio (AMPL/IPOPT/SNOPT)	Status (AMPL/IPOPT)	Obj (SNOPT)
`chain100`	`14.2400`	`5.2283`	---	`mstat(14) sstat(10)`	`5.06978461`
`chain200`	`31.5100`	`12.2627`	---	`mstat(14) sstat(10)`	`5.06891741`
`chain400`	`113.5300`	`69.1914`	---	`mstat(14) sstat( 2)`	`5.06862171`
`chain50`	`3.4200`	`0.9158`	---	`mstat(14) sstat(10)`	`5.07226150`
`elec100`	`598.1000`	`27.9703`	---	`mstat(14) sstat( 2)`	`4448.35063497`
`elec200`	`2629.1300`	`228.0921`	---	`mstat(14) sstat(10)`	`18439.17324325`
`elec50`	`92.6000`	`3.2654`	---	`mstat(14) sstat( 2)`	`1055.18231474`
`glider100`	`99999.0000`	`23.7778`	---	`mstat(13) sstat(13)`	`249.91183126`
`glider200`	`2532.2900`	`112.4806`	---	`mstat(14) sstat( 2)`	`249.89239133`
`glider400`	`99999.0000`	`512.7804`	---	`mstat(13) sstat(13)`	`249.98584865`
`glider50`	`1151.9900`	`8.1350`	---	`mstat(14) sstat( 2)`	`-249.99765428`
`polygon100`	`299.5500`	`58.4674`	---	`mstat(14) sstat(10)`	`-0.78504087`
`polygon25`	`17.6400`	`0.2846`	---	`mstat(14) sstat(10)`	`-0.77974061`
`polygon50`	`90.3600`	`3.1147`	---	`mstat(14) sstat( 2)`	`-0.78401615`
`popdynm100`	`680.6500`	`46.9368`	---	`mstat(14) sstat( 2)`	`19746528.60217240`
`popdynm200`	`2485.8700`	`192.1450`	---	`mstat(14) sstat( 2)`	`19746529.64660500`
`popdynm25`	`66.1100`	`3.8047`	---	`mstat(14) sstat( 2)`	`19752215.41510840`
`robot100`	`99999.0000`	`41.2986`	---	`mstat(13) sstat(13)`	`9.14268538`
`robot200`	`99999.0000`	`105.8019`	---	`mstat(13) sstat(13)`	`9.14139550`
`robot400`	`99999.0000`	`1527.9962`	---	`mstat(13) sstat(13)`	`9.14102603`
`robot50`	`99999.0000`	`4.5815`	---	`mstat(13) sstat(13)`	`9.14687850`

AMPL/IPOPT: locally optimal: Back to top

Modelname	Time (AMPL/IPOPT)	Obj (AMPL/IPOPT)
`camshape100`	`0.2600`	`-4.28414700`
`camshape200`	`3.1200`	`-4.27850000`
`camshape400`	`5.5200`	`-4.27568700`
`camshape800`	`4.9300`	`-4.27427200`
`catmix100`	`0.6700`	`-0.04806930`
`catmix200`	`4.5300`	`-0.04805893`
`catmix400`	`4.2100`	`-0.04805617`
`catmix800`	`6.8900`	`-0.04805512`
`elec25`	`5.9200`	`244.40240000`
`gasoil100`	`2.0300`	`0.00523659`
`gasoil200`	`5.1100`	`0.00523660`
`gasoil400`	`14.1700`	`0.00523660`
`gasoil50`	`0.8800`	`0.00523664`
`jbearing100`	`3.6900`	`-0.15503780`
`jbearing25`	`1.4400`	`-0.15482210`
`jbearing50`	`1.4400`	`-0.15482210`
`jbearing75`	`2.5300`	`-0.15498130`
`lnts100`	`0.3200`	`0.55459540`
`lnts200`	`1.0800`	`0.55457700`
`lnts400`	`1.3200`	`0.55457240`
`lnts50`	`0.1500`	`0.55466880`
`methanol100`	`6.6900`	`0.00902229`
`methanol200`	`5.5600`	`0.00902229`
`methanol400`	`12.7600`	`0.00902229`
`methanol50`	`1.2200`	`0.00902229`
`minsurf100`	`50.8500`	`2.50695100`
`minsurf25`	`2.2800`	`2.51948900`
`minsurf50`	`12.4900`	`2.51489100`
`minsurf75`	`20.1100`	`2.50568800`
`pinene100`	`249.3000`	`19.87217000`
`pinene200`	`5.9100`	`19.87217000`
`pinene25`	`3.5300`	`19.87217000`
`pinene50`	`3.6300`	`19.87217000`
`polygon75`	`100.9800`	`-0.73723350`
`popdynm50`	`253.6000`	`19746550.00000000`
`rocket100`	`6.7500`	`-1.01283200`
`rocket200`	`25.9700`	`-1.01283500`
`rocket400`	`138.4000`	`-1.01283500`
`rocket50`	`7.0600`	`-1.01281700`
`torsion100`	`21.2700`	`-0.41823540`
`torsion25`	`2.3400`	`-0.41750980`
`torsion50`	`4.9600`	`-0.41808570`
`torsion75`	`10.5900`	`-0.41819660`

AMPL/IPOPT: fail: Back to top

Modelname	Time (AMPL/IPOPT)	Status (AMPL/IPOPT)
`chain100`	`--`	`mstat(14) sstat(10)`
`chain200`	`--`	`mstat(14) sstat(10)`
`chain400`	`--`	`mstat(14) sstat( 2)`
`chain50`	`--`	`mstat(14) sstat(10)`
`elec100`	`--`	`mstat(14) sstat( 2)`
`elec200`	`--`	`mstat(14) sstat(10)`
`elec50`	`--`	`mstat(14) sstat( 2)`
`glider100`	`--`	`mstat(13) sstat(13)`
`glider200`	`--`	`mstat(14) sstat( 2)`
`glider400`	`--`	`mstat(13) sstat(13)`
`glider50`	`--`	`mstat(14) sstat( 2)`
`polygon100`	`--`	`mstat(14) sstat(10)`
`polygon25`	`--`	`mstat(14) sstat(10)`
`polygon50`	`--`	`mstat(14) sstat( 2)`
`popdynm100`	`--`	`mstat(14) sstat( 2)`
`popdynm200`	`--`	`mstat(14) sstat( 2)`
`popdynm25`	`--`	`mstat(14) sstat( 2)`
`robot100`	`--`	`mstat(13) sstat(13)`
`robot200`	`--`	`mstat(13) sstat(13)`
`robot400`	`--`	`mstat(13) sstat(13)`
`robot50`	`--`	`mstat(13) sstat(13)`

SNOPT: locally optimal: Back to top

Modelname	Time (SNOPT)	Obj (SNOPT)
`camshape100`	`0.2021`	`-4.28411473`
`camshape200`	`0.5613`	`-4.27844288`
`camshape400`	`2.3875`	`-4.27567050`
`camshape800`	`10.4830`	`-4.26882831`
`catmix100`	`0.9430`	`-0.04805960`
`catmix200`	`4.1085`	`-0.04804863`
`catmix400`	`16.9614`	`-0.04804385`
`catmix800`	`45.8012`	`-0.04769665`
`chain100`	`5.2283`	`5.06978461`
`chain200`	`12.2627`	`5.06891741`
`chain400`	`69.1914`	`5.06862171`
`chain50`	`0.9158`	`5.07226150`
`elec100`	`27.9703`	`4448.35063497`
`elec200`	`228.0921`	`18439.17324325`
`elec25`	`1.6156`	`243.81276030`
`elec50`	`3.2654`	`1055.18231474`
`gasoil100`	`11.4082`	`0.00523659`
`gasoil200`	`51.2104`	`0.00523660`
`gasoil400`	`184.5658`	`0.00523660`
`gasoil50`	`4.0092`	`0.00523664`
`glider100`	`23.7778`	`249.91183126`
`glider200`	`112.4806`	`249.89239133`
`glider400`	`512.7804`	`249.98584865`
`glider50`	`8.1350`	`-249.99765428`
`jbearing25`	`1682.6603`	`-0.15482422`
`jbearing50`	`1676.3090`	`-0.15482422`
`lnts100`	`2.9824`	`0.55459616`
`lnts200`	`12.0809`	`0.55457719`
`lnts400`	`40.0331`	`0.55457260`
`lnts50`	`0.8985`	`0.55466877`
`methanol100`	`15.8370`	`0.00902229`
`methanol200`	`66.1694`	`0.00902229`
`methanol400`	`231.1582`	`0.00902229`
`methanol50`	`4.5836`	`0.00902229`
`minsurf25`	`32.9513`	`2.51948768`
`pinene100`	`38.5003`	`19.87217015`
`polygon100`	`58.4674`	`-0.78504087`
`polygon25`	`0.2846`	`-0.77974061`
`polygon50`	`3.1147`	`-0.78401615`
`polygon75`	`21.0867`	`0.78476976`
`popdynm100`	`46.9368`	`19746528.60217240`
`popdynm200`	`192.1450`	`19746529.64660500`
`popdynm25`	`3.8047`	`19752215.41510840`
`popdynm50`	`12.5029`	`19746545.15628000`
`robot100`	`41.2986`	`9.14268538`
`robot200`	`105.8019`	`9.14139550`
`robot400`	`1527.9962`	`9.14102603`
`robot50`	`4.5815`	`9.14687850`
`rocket100`	`9.5687`	`-1.01281060`
`rocket200`	`21.3875`	`-1.01267680`
`rocket400`	`97.0642`	`-1.01127925`
`rocket50`	`3.0099`	`-1.01280636`
`torsion25`	`26.7392`	`-0.41751073`
`torsion50`	`370.4744`	`-0.41808761`
`torsion75`	`1614.0668`	`-0.41819939`

SNOPT: feasible: Back to top

Modelname	Time (SNOPT)	Obj (SNOPT)
`jbearing75`	`3600.3621`	`-0.11165267`
`minsurf100`	`3602.0874`	`2.51369838`
`minsurf50`	`3600.5754`	`2.51532033`
`minsurf75`	`3600.5146`	`2.51143788`
`pinene200`	`133.1218`	`19.87216684`
`pinene25`	`9.1851`	`19.87216553`
`pinene50`	`9.1420`	`19.87216553`
`torsion100`	`3600.7263`	`-0.41823749`

SNOPT: fail: Back to top

Modelname	Time (SNOPT)	Status (SNOPT)
`jbearing100`	`--`	`mstat(13) sstat(13)`