New horizons in sphere-packing theory, part II: lattice-based derivative-free optimization via global surrogates
Derivative-free algorithms are frequently required for the optimization of nonsmooth scalar functions in n dimensions resulting, for example, from physical experiments or from the statistical averaging of numerical simulations of chaotic systems such as turbulent flows. The core idea of all efficient algorithms for problems of this type is to keep function evaluations far apart until convergence is approached. Generalized pattern search (GPS) algorithms, a modern class of methods particularly well suited to such problems, accomplish this by coordinating the search with an underlying grid which is refined, and coarsened, as appropriate. One of the most efficient subclasses of GPS algorithms, known as the surrogate management framework (SMF; see Booker et al. in Struct Multidiscip Optim 17:1–13, <CitationRef CitationID="CR4">1999</CitationRef>), alternates between an exploratory search over an interpolating function which summarizes the trends exhibited by existing function evaluations, and an exhaustive poll which checks the function on neighboring points to confirm or confute the local optimality of any given candidate minimum point (CMP) on the underlying grid. The original SMF algorithm implemented a GPS step on an underlying Cartesian grid, augmented with a Kriging-based surrogate search. Rather than using the n-dimensional Cartesian grid (the typical choice), the present work introduces for this purpose the use of lattices derived from n-dimensional sphere packings. As reviewed and analyzed extensively in Part I of this series (see Belitz, PhD dissertation, University of California, San Diego, <CitationRef CitationID="CR3">2011</CitationRef>, Chap. 2), such lattices are significantly more uniform and have many more nearest neighbors than their Cartesian counterparts. Both of these facts make them far better suited for coordinating GPS algorithms, as demonstrated here in a variety of numerical tests. Copyright Springer Science+Business Media, LLC. 2013
Year of publication: |
2013
|
---|---|
Authors: | Belitz, Paul ; Bewley, Thomas |
Published in: |
Journal of Global Optimization. - Springer. - Vol. 56.2013, 1, p. 61-91
|
Publisher: |
Springer |
Subject: | N-dimensional sphere-packing theory | Generalized pattern search | Derivative-free optimization | Global optimization | Surrogate-based methods | Kriging interpolation |
Saved in:
Saved in favorites
Similar items by subject
-
Incorporating minimum Frobenius norm models in direct search
Custódio, A., (2010)
-
Clonal selection: an immunological algorithm for global optimization over continuous spaces
Pavone, Mario, (2012)
-
Thi, H. Le, (2012)
- More ...
Similar items by person