Money for Nothing: Speeding Up Evolutionary Algorithms Through Better Initialization

Axel de Perthuis de Laillevault , Benjamin Doerr (1) , Carola Doerr (2, 3)

1 LIX - Laboratoire d'informatique de l'École polytechnique [Palaiseau]
2 RO - Recherche Opérationnelle
3 CNRS - Centre National de la Recherche Scientifique

That the initialization can have a significant impact on the performance of evolutionary algorithms (EAs) is a well known fact in the empirical evolutionary computation literature. Surprisingly, it has nevertheless received only little attention from the theoretical community. We bridge this gap by providing a thorough runtime analysis for a simple iterated random sampling initialization. In the latter, instead of starting an EA with a random sample, it is started in the best of k search points that are taken from the search space uniformly at random. Implementing this strategy comes at almost no cost, neither in the actual coding work nor in terms of wall-clock time. Taking the best of two random samples already decreases the Θ(n log n) expected runtime of the (1+1)~EA and Randomized Local Search on OneMax by an additive term of order √n. The optimal gain that one can achieve with iterated random sampling is an additive term of order √n log n}. This also determines the best possible mutation-based EA for OneMax, a question left open in [Sudholt, IEEE TEC 2013]. At the heart of our analysis is a very precise bound for the maximum of k independent Binomially distributed variables with success probability 1/2.

Domaines: Informatique [cs]

Axel de Perthuis de Laillevault, Benjamin Doerr, Carola Doerr. Money for Nothing: Speeding Up Evolutionary Algorithms Through Better Initialization. GECCO '15 - 2015 Annual Conference on Genetic and Evolutionary Computation, Jul 2015, Madrid, Spain. pp.815-822, ⟨10.1145/2739480.2754760⟩. ⟨hal-01272863⟩