, optimum: practically, they are local (although CMA-ES is asymptotically convergent to the global optimum and Nelder-Mead may go over regions of attraction to local optima)
, CMA-ES at convergence (possibly force a few early convergences for restarts
,
Linear convergence of comparison-based step-size adaptive randomized search via stability of markov chains, SIAM Journal on Optimization, vol.26, issue.3, pp.1589-1624, 2016. ,
URL : https://hal.archives-ouvertes.fr/hal-00877160
Introduction to Derivative-Free Optimization, Society for Industrial and Applied Mathematics, 2009. ,
The CMA Evolution Strategy: A Tutorial, 2005. ,
URL : https://hal.archives-ouvertes.fr/hal-01297037
Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation, pp.312-317, 1996. ,
Completely derandomized self-adaptation in evolution strategies, Evol. Comput, vol.9, issue.2, pp.159-195, 2001. ,
The NLopt nonlinear-optimization package, 2011. ,
Efficient global optimization of expensive black-box functions, Journal of Global optimization, vol.13, issue.4, pp.455-492, 1998. ,
Convergence properties of the Nelder-Mead simplex method in low dimensions, SIAM Journal on Optimization, vol.9, issue.1, pp.112-147, 1998. ,
Cma-es with restarts for solving cec 2013 benchmark problems, IEEE Congress on Evolutionary Computation, pp.369-376, 2013. ,
URL : https://hal.archives-ouvertes.fr/hal-00823880
Intensive Surrogate Model Exploitation in Self-adaptive Surrogate-assisted CMA-ES (saACM-ES) ,
URL : https://hal.archives-ouvertes.fr/hal-00818595
, Genetic and Evolutionary Computation Conference (GECCO 2013), pp.439-446, 2013.
Globalized nelder-mead method for engineering optimization, Computers & Structures, vol.82, issue.23, pp.2251-2260, 2004. ,
Convergence of the nelder-mead simplex method to a nonstationary point, SIAM Journal on Optimization, vol.9, issue.1, pp.148-158, 1998. ,
Making EGO and CMA-ES Complementary for Global Optimization, Learning and Intelligent Optimization, vol.8994, pp.287-292, 2015. ,
URL : https://hal.archives-ouvertes.fr/emse-01168512
A simplex method for function minimization, The Computer Journal, vol.7, issue.4, pp.308-313, 1965. ,
Information-geometric optimization algorithms: A unifying picture via invariance principles, Journal of Machine Learning Research, 2017. ,
URL : https://hal.archives-ouvertes.fr/hal-00601503
Fortified-descent simplicial search method: A general approach, SIAM J. Optim, vol.10, pp.269-288, 1999. ,
, CNRS EMSE) Optimization without metamodel 38/38 March, vol.38, p.38, 2018.