Adaptive Encoding: How to Render Search Coordinate System Invariant

Nikolaus Hansen (1, 2)

1 MSR - INRIA - Microsoft Research - Inria Joint Centre
2 TAO - Machine Learning and Optimisation

This paper describes a method for rendering search coordinate system independent, Adaptive Encoding. Adaptive Encoding is applicable to any iterative search algorithm and employs incremental changes of the representation of solutions. One attractive way to change the representation in the continuous domain is derived from Covariance Matrix Adaptation (CMA). In this case, adaptive encoding recovers the CMA evolution strategy, when applied to an evolution strategy with cumulative step-size control. Consequently, adaptive encoding provides the means to apply CMA-like representation changes to any search algorithm in the continuous domain. Experimental results confirm the expectation that CMA-based adaptive encoding will generally speed up a typical evolutionary algorithm on non-separable, ill-conditioned problems by orders of magnitude.

Domains: Machine Learning [cs.LG]

Nikolaus Hansen. Adaptive Encoding: How to Render Search Coordinate System Invariant. Parallel Problem Solving from Nature - PPSN X, Sep 2008, Dortmund, Germany. pp.205-214. ⟨inria-00287351v3⟩