Automatic selection for general surrogate models

Abstract : In design engineering problems, the use of surro-gate models (also called metamodels) instead of expensive simulations have become very popular. Surrogate models include individual models (regression, kriging, neural network ...) or a combination of individual models often called aggregation or ensemble. Since different surrogate types with various tunings are available, users often struggle to choose the most suitable one for a given problem. Thus, there is a great interest in automatic selection algorithms. In this paper , we introduce a universal criterion that can be applied to any type of surrogate models. It is composed of three complementary components measuring the quality of general surrogate models: internal accuracy (on design points), predictive performance (cross-validation) and a roughness penalty. Based on this criterion, we propose two automatic selection algorithms. The first selection scheme finds the optimal ensemble of a set of given surrogate models. The second selection scheme further explores the space of surrogate models by using an evolutionary algorithm where each individual is a surrogate model. Finally, the performances of the algorithms are illustrated on 15 classical test functions and compared to different individual surrogate models. The results show the efficiency of our approach. observe that the three components of the proposed criterion act all together to improve accuracy and limit over-fitting.
Document type :
Journal articles
Complete list of metadatas

Cited literature [30 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01685848
Contributor : Malek Ben Salem <>
Submitted on : Tuesday, January 16, 2018 - 5:30:38 PM
Last modification on : Friday, March 22, 2019 - 10:27:12 AM
Long-term archiving on : Saturday, May 5, 2018 - 8:34:59 PM

File

PPS_paper_rev (2).pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01685848, version 1

Données associées

Citation

Malek Ben Salem, Lionel Tomaso. Automatic selection for general surrogate models. Structural and Multidisciplinary Optimization, Springer Verlag (Germany), 2018. ⟨hal-01685848⟩

Share

Metrics

Record views

84

Files downloads

124