Abstract
Our strategic objective is to develop a broadly categorized, expandable collection of test problems, to support the benchmarking of nonlinear optimization software packages in integrated technical computing environments (ITCEs). ITCEs—such as Maple, Mathematica, and MATLAB—support concise, modular and scalable model development: their built-in documentation and visualization features can be put to good use also in test model selection and analysis. ITCEs support the flexible inclusion of both new models and general-purpose solver engines for future studies. Within this broad context, in this article we review a collection of global optimization problems coded in Mathematica, and present illustrative and summarized numerical results obtained using the MathOptimizer Professional software package.
Similar content being viewed by others
References
Addis B, Locatelli M (2007) A new class of test functions for global optimization. J Glob Optim 38:479–501
Addis B, Locatelli M, Schoen F (2008) Efficiently packing unequal disks in a circle. Oper Res Lett 36(1):37–42
Ali MM, Khompatraporn Ch, Zabinsky ZB (2005) A numerical evaluation of several global optimization algorithms on selected test problems. J Glob Optim 31:635–672
AMPL LLC (2011) AMPL; www.ampl.com
Averick BM, Moré JJ (1991) The Minpack-2 test problem collection. Technical report ANL/MCS-TM-157, Argonne National Laboratory, Argonne, IL
Barr RS, Golden BL, Kelly JP, Resende MGC, Stewart WR (1995) Designing and reporting on computational experiments with heuristic methods. J Heuristics 1:9–32
Berna TJ, Locke MH, Westerberg AW (1980) A new approach to optimization of chemical processes. AIChE J 26(1):37–43
Bhatti AM (2000) Practical optimization methods with Mathematica applications. Springer, New York
Bongartz I, Conn AR, Gould NIM, Toint PhL (1995) CUTE: constrained and unconstrained testing environment. ACM Trans Math Softw 21(1):123–160
Buckley AG (1992) Algorithm 709: testing algorithm implementations. ACM Trans Math Softw 18(4):375–391
Casado LC, García I, Martínez JA, Sergeyev YD (2003) New interval analysis support functions using gradient information in a global minimization algorithm. J Glob Optim 25:345–362
Castillo I, Kampas FJ, Pintér JD (2008) Solving circle packing problems by global optimization: numerical results and industrial applications. Eur J Oper Res 191:786–802
Csendes T, Pál L, Sendin OH, Banga JR (2008) The GLOBAL optimization method revisited. Optim Lett 2:445–454
Dimmer PR, Cutteridge OPD (1980) Second derivative Gauss–Newton-based method for solving nonlinear simultaneous equations. IEE Proc G, Electron Circuits Syst 127:278–283
Dixon L, Szegö G (eds) (1975) Towards global optimisation, vol 1. North-Holland, Amsterdam
Dixon L, Szegö G (eds) (1978) Towards global optimisation, vol 2. North-Holland, Amsterdam
Dolan ED, Moré JJ (2002) Benchmarking optimization software with performance profiles. Math Program, Ser A 91:201–213
Dolan ED, Moré JJ, Munson TS (2004) Benchmarking optimization software with COPS 3.0. Technical report ANL/MCS-TM-273, Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL
Doye JPK, Leary RH, Locatelli M, Schoen F (2004) The global optimization of Morse clusters by potential energy transformations. INFORMS J Comput 16:371–379
Ebers JJ, Moll JL (1954) Large signal behaviour of junction transistors. Proc IRE 42:1761–1772
Fasano G (2008) MIP-based heuristic for non-standard 3D-packing problems. 4OR 6:291–310
Fasano G, Saia D, Piras A (2010) Columbus stowage optimization by CAST (Cargo Accommodation Support Tool). Acta Astronaut 67(3):489–496
Floudas CA, Pardalos PM, Adjiman CS, Esposito WR, Gümüş ZH, Harding ST, Klepeis JL, Meyer CA, Schweiger CA (1999) Handbook of test problems in local and global optimization. Kluwer Academic, Dordrecht
GAMS Development Corporation (2011) GAMS; www.gams.com
GAMS Global World (2011) GLOBAL Library: a collection of nonlinear programming models; www.gamsworld.org/global/globallib.htm
GAMS Performance World (2011) www.gamsworld.org/performance/index.htm
Gaviano M, Kvasov DE, Lera D, Sergeyev YD (2003) Algorithm 829: software for generation of classes of test functions with known local and global minima for global optimization. ACM Trans Math Softw 29(4):469–480
Gould NIM, Orban D, Toint PL (2003) CUTEr and SifDec: a constrained and unconstrained testing environment, revisited. ACM Trans Math Softw 29(4):373–394
Grossmann IE (ed) (1996) Global optimization in engineering design. Kluwer Academic, Dordrecht
Hansen P, Jaumard B, Lu S-H (1992) Global optimization of univariate Lipschitz functions: II. New algorithms and computational comparison. Math Program 55:273–292
Hare WL, Wang Y (2010) Fairer benchmarking of optimization algorithms via derivative free optimization. Available from Optimization Online, www.optimization-online.org/DB_HTML/2010/10/2765.html
Hock W, Schittkowski K (1981) Test examples for nonlinear programming codes. Lecture notes in economics and mathematical systems, vol 187. Springer, Berlin
Hock W, Schittkowski K (1983) A comparative performance evaluation of 27 nonlinear programming codes. Computing 30:335–358
Jackson RHF, Boggs PT, Nash SG, Powell S (1991) Guidelines for reporting results of computation experiments. Report of the ad hoc committee. Math Program 49:413–425
Kampas FJ, Pintér JD (2006) Configuration analysis and design by using optimization tools in Mathematica. Math J 10:128–154
Khompatraporn Ch, Pintér JD, Zabinsky ZB (2005) Comparative assessment of algorithms and software for global optimization. J Glob Optim 31:613–633
Lahey Computer Systems (2004) Lahey/Fujitsu FORTRAN 95 (Release 5.70f), www.lahey.com
Lavor C, Liberti L, Maculan N (2006) Computational experience with the molecular distance geometry problem. In: Pintér JD (ed) Global optimization: selected case studies. Springer, New York
LINDO Systems (2011) LINGO; www.lindo.com
Liu D, Zhang X-S (2000) Test problem generator by neural network for algorithms that try solving nonlinear programming problems globally. J Glob Optim 16:229–243
Luksan L, Vlçek J (2000) Test problems for non-smooth unconstrained and linearly constrained optimization. Technical report 798, Institute of Computer Science, Academy of Sciences of the Czech Republic, Prague
Maplesoft (2011a) Maple. Maplesoft, Inc, Waterloo, ON; www.maplesoft.com
Maplesoft (2011b) Maple Global Optimization Toolbox. Maplesoft, Inc, Waterloo, ON; www.maplesoft.com/products/toolboxes/globaloptimization/
Maximal Software (2011) MPL. Maximal Software, Inc, Arlington, VA; www.maximal-usa.com
Michalewicz Z (1996) Genetic algorithms + data structures = evolution programs. Springer, Heidelberg
Mittelmann HD (2011) Decision tree for optimization software; plato.la.asu.edu/guide.html
Moré JJ, Garbow BS, Hillström KE (1981) Testing unconstrained optimization software. ACM Trans Math Softw 7:17–41
Moré JJ, Wild SM (2009) Benchmarking derivative-free optimization algorithms. SIAM J Optim 20(1):172–191
Müller A, Schneider JJ, Schömer E (2009) Packing a multidisperse system of hard disks in a circular environment. Phys Rev E 79:021102 (14 pages)
Neumaier A (2011) Global optimization; www.mat.univie.ac.at/~neum/glopt.html
Neumaier A, Shcherbina O, Huyer W, Vinkó T (2005) A comparison of complete global optimization solvers. Math Program, Ser B 103:335–356
Papalambros PM, Wilde DJ (2000) Principles of optimal design—modeling and computation, 2nd edn. Cambridge University Press, Cambridge
Paragon Decision Technology (2011) AIMMS. Paragon Decision Technology BV, Haarlem, The Netherlands; www.aimms.com
Pál L, Csendes T (2009) INTLAB implementation of an interval global optimization algorithm. Optim Methods Softw 24(4):749–759
Pintér JD (1996a) Global optimization in action. Kluwer Academic, Dordrecht
Pintér JD (1996b) Continuous global optimization software: a brief review. Optima 52:1–8. See also at http://plato.la.asu.edu/gom.html
Pintér JD (1997) LGO: A program system for continuous and Lipschitz optimization. In: Bomze IM, Csendes T, Horst R, Pardalos PM (eds) Developments in global optimization. Kluwer Academic, Dordrecht, pp 183–197
Pintér JD (2001) Globally optimized spherical point arrangements: model variants and illustrative results. Ann Oper Res 104:213–230
Pintér JD (2002) Global optimization: software, test problems, and applications. In: Pardalos PM, Romeijn HE (eds) Handbook of global optimization, vol 2. Kluwer Academic, Dordrecht, pp 515–569
Pintér JD (2005) Nonlinear optimization in modeling environments: software implementations for compilers, spreadsheets, modeling languages, and integrated computing systems. In: Jeyakumar V, Rubinov AM (eds) Continuous optimization: current trends and applications. Springer, New York, pp 147–173
Pintér JD (2006a) Global optimization with Maple: an introduction with illustrative examples. An electronic book published by Pintér Consulting Services, Canada
Pintér JD (ed) (2006b) Global optimization: selected case studies. Springer, New York
Pintér JD (2007) Nonlinear optimization with GAMS/LGO. J Glob Optim 38:79–101
Pintér JD (2009a) Global optimization in practice: state-of-the-art and perspectives. In: Gao DY, Sherali HD (eds) Advances in applied mathematics and global optimization. Springer, New York, pp 377–404
Pintér JD (2009b) Software development for global optimization. In: Pardalos PM, Coleman TF (eds) Global optimization: methods and applications. Fields institute communications, vol 55. American Mathematical Society, Providence, pp 183–204
Pintér JD, Bagirov A, Zhang J (2003) An illustrated collection of global optimization test problems. Research report, School of Information Technology & Mathematical Sciences, University of Ballarat, Victoria, Australia
Pintér JD, Kampas FJ (2005) Nonlinear optimization in Mathematica with MathOptimizer Professional. Math Educ Res 10(2):1–18
Pintér JD, Kampas FJ (2006) MathOptimizer Professional: key features and illustrative applications. In: Liberti L, Maculan N (eds) Global optimization: from theory to implementation. Springer, New York, pp 263–279
Pintér JD, Kampas FJ (2010a) MathOptimizer—an advanced modeling and optimization system for Mathematica users. User’s guide. (MathOptimizer is developed and maintained since 2002 by Pintér Consulting Services, Inc, Canada; www.pinterconsulting.com)
Pintér JD, Kampas FJ (2010b) MathOptimizer Professional—an advanced modeling and optimization system for Mathematica, using the LGO Solver Engine. User’s guide. (MathOptimizer Professional is developed and maintained since 2003 by Pintér Consulting Services, Inc, Canada; www.pinterconsulting.com)
Pintér JD, Linder D, Chin P (2006) Global optimization toolbox for Maple: an introduction with illustrative applications. Optim Methods Softw 21(4):565–582
Rakhmanov EA, Saff EB, Zhou YM (1995) Electrons on the sphere. In: Ali RM, Ruscheweyh S, Saff EB (eds) Computational methods and function theory. World Scientific, Singapore, pp 111–127
Ratschek H, Rokne J (1993) Experiments using interval analysis for solving a circuit design problem. J Glob Optim 3:501–518
Rios LM, Sahinidis NV (2010) Derivative-free optimization: a review of algorithms and comparison of software implementations. Technical report, Department of Chemical Engineering, Carnegie Mellon University, Pittsburgh, PA (to appear)
Shcherbina O, Neumaier A, Sam-Haroud D, Vu X-H, Tuan-Viet N (2003) Benchmarking global optimization and constraint satisfaction codes. In: Bliek Ch et al. (eds) Global optimization and constraint satisfaction. Springer, Berlin, pp 211–222
Schichl H (2003) Global optimization in the COCONUT project. Manuscript, www.mat.univie.ac.at/~herman/papers.html
Schittkowski K (1987) More test examples for nonlinear programming. Lecture notes in economics and mathematical systems, vol 182. Springer, Berlin
Schittkowski K (2008) An updated set of 306 test problems for nonlinear programming with validated optimal solutions—user’s guide. Research report, Department of Computer Science, University of Bayreuth
Schoen F (1993) A wide class of test functions for global optimization. J Glob Optim 3:133–137
Schoen F (2008) Personal communication
Stortelder WJH, de Swart JJB, Pintér JD (2001) Finding elliptic Fekete points sets: two numerical solution approaches. J Comput Appl Math 130:205–216
Tang K, Li X, Suganthan PN, Yang Z, Weise T (2010) Benchmark functions for the CEC’2010 special session and competition on large-scale global optimization. Online research document, January 8, 2010. For possible updates, visit www.it-weise.de/
Tawarmalani M, Sahinidis NV (2002) Convexification and global optimization in continuous and mixed-integer nonlinear programming. Kluwer Academic, Dordrecht
The MathWorks (2011a) MATLAB. The MathWorks, Inc, Natick, MA; www.mathworks.com
The MathWorks (2011b) MATLAB global optimization toolbox 3 user’s guide. The MathWorks, Inc, Natick, MA; www.mathworks.com
TOMLAB Optimization (2011) TOMLAB. TOMLAB Optimization AB, Västerås, Sweden; www.tomopt.com
Trott M (2004, 2006) The Mathematica GuideBooks. Programming, graphics, numerics, symbolics, vols 1–4. Springer, New York
Vanderbei RJ (2011) Nonlinear optimization models; www.princeton.edu/~rvdb/ampl/nlmodels/
Weise T (2011) Global optimization algorithms—theory and application; www.it-weise.de/
Wolfram Research (2011) Mathematica. Wolfram Research, Inc, Champaign, IL; www.wolfram.com
Wolfram S (2003) The Mathematica book, 5th edn. Wolfram Media, Inc, Champaign. Online reference http://reference.wolfram.com/mathematica/guide/Mathematica.html
Zabinsky ZB (2003) Stochastic adaptive search for global optimization. Kluwer Academic, Dordrecht
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pintér, J.D., Kampas, F.J. Benchmarking nonlinear optimization software in technical computing environments. TOP 21, 133–162 (2013). https://doi.org/10.1007/s11750-011-0209-5
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11750-011-0209-5
Keywords
- Nonlinear optimization in integrated technical computing environments
- Optimization software benchmarking
- Model library in Mathematica
- Lipschitz Global Optimizer (LGO) solver suite for nonlinear optimization
- MathOptimizer Professional (LGO linked to Mathematica)
- Numerical performance results