Mirrored Sampling and Sequential Selection for Evolution Strategies

Dimo Brockhoff 1 Anne Auger 1 Nikolaus Hansen 1 Dirk Arnold 2 Tim Hohm 3
1 TAO - Machine Learning and Optimisation
LRI - Laboratoire de Recherche en Informatique, UP11 - Université Paris-Sud - Paris 11, Inria Saclay - Ile de France, CNRS - Centre National de la Recherche Scientifique : UMR8623
Abstract : This paper reveals the surprising result that a single-parent non-elitist evolution strategy (ES) can be locally faster than the (1+1)-ES. The result is brought about by mirrored sampling and sequential selection. With mirrored sampling, two offspring are generated symmetrically or mirrored with respect to their parent. In sequential selection, the offspring are evaluated sequentially and the it- eration is concluded as soon as one offspring is better than the current parent. Both concepts complement each other well. We derive exact convergence rates of the (1, λ)-ES with mirrored sampling and/or sequential selection on the sphere model. The log-linear convergence of the ES is preserved. Both methods lead to an improvement and in combination the (1,4)-ES becomes about 10% faster than the (1+1)-ES. Naively implemented into the CMA-ES with recombination, mirrored sampling leads to a bias on the step-size. However, the (1,4)-CMA-ES with mirrored sampling and sequential selection is unbiased and appears to be faster, more robust, and as local as the (1+1)-CMA-ES.
Document type :
Conference papers
PPSN, Sep 2010, Warsaw, Poland. pp.11-21, 2010, Parallel Problem Solving from Nature (PPSN XI)
Liste complète des métadonnées


https://hal.inria.fr/inria-00530202
Contributor : Nikolaus Hansen <>
Submitted on : Thursday, March 31, 2011 - 9:35:17 PM
Last modification on : Thursday, February 9, 2017 - 3:55:11 PM

File

brockhoff2010mirrored.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : inria-00530202, version 2

Collections

Citation

Dimo Brockhoff, Anne Auger, Nikolaus Hansen, Dirk Arnold, Tim Hohm. Mirrored Sampling and Sequential Selection for Evolution Strategies. PPSN, Sep 2010, Warsaw, Poland. pp.11-21, 2010, Parallel Problem Solving from Nature (PPSN XI). <inria-00530202v2>

Share

Metrics

Record views

239

Document downloads

191