Skip to Main content Skip to Navigation
Journal articles

Automatic selection for general surrogate models

Abstract : In design engineering problems, the use of surro-gate models (also called metamodels) instead of expensive simulations have become very popular. Surrogate models include individual models (regression, kriging, neural network ...) or a combination of individual models often called aggregation or ensemble. Since different surrogate types with various tunings are available, users often struggle to choose the most suitable one for a given problem. Thus, there is a great interest in automatic selection algorithms. In this paper , we introduce a universal criterion that can be applied to any type of surrogate models. It is composed of three complementary components measuring the quality of general surrogate models: internal accuracy (on design points), predictive performance (cross-validation) and a roughness penalty. Based on this criterion, we propose two automatic selection algorithms. The first selection scheme finds the optimal ensemble of a set of given surrogate models. The second selection scheme further explores the space of surrogate models by using an evolutionary algorithm where each individual is a surrogate model. Finally, the performances of the algorithms are illustrated on 15 classical test functions and compared to different individual surrogate models. The results show the efficiency of our approach. observe that the three components of the proposed criterion act all together to improve accuracy and limit over-fitting.
Document type :
Journal articles
Complete list of metadata

Cited literature [30 references]  Display  Hide  Download
Contributor : Malek BEN SALEM Connect in order to contact the contributor
Submitted on : Tuesday, January 16, 2018 - 5:30:38 PM
Last modification on : Wednesday, June 24, 2020 - 4:19:13 PM
Long-term archiving on: : Saturday, May 5, 2018 - 8:34:59 PM


PPS_paper_rev (2).pdf
Files produced by the author(s)


  • HAL Id : hal-01685848, version 1


Malek Ben Salem, Lionel Tomaso. Automatic selection for general surrogate models. Structural and Multidisciplinary Optimization, Springer Verlag (Germany), 2018. ⟨hal-01685848⟩



Record views


Files downloads