Additive Kernels for Gaussian Process Modeling

Abstract : Gaussian Process (GP) models are often used as mathematical approximations of computationally expensive experiments. Provided that its kernel is suitably chosen and that enough data is available to obtain a reasonable fit of the simulator, a GP model can beneficially be used for tasks such as prediction, optimization, or Monte-Carlo-based quantification of uncertainty. However, the former conditions become unrealistic when using classical GPs as the dimension of input increases. One popular alternative is then to turn to Generalized Additive Models (GAMs), relying on the assumption that the simulator's response can approximately be decomposed as a sum of univariate functions. If such an approach has been successfully applied in approximation, it is nevertheless not completely compatible with the GP framework and its versatile applications. The ambition of the present work is to give an insight into the use of GPs for additive models by integrating additivity within the kernel, and proposing a parsimonious numerical method for data-driven parameter estimation. The first part of this article deals with the kernels naturally associated to additive processes and the properties of the GP models based on such kernels. The second part is dedicated to a numerical procedure based on relaxation for additive kernel parameter estimation. Finally, the efficiency of the proposed method is illustrated and compared to other approaches on Sobol's g-function.
Liste complète des métadonnées

Cited literature [14 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00446520
Contributor : Nicolas Durrande <>
Submitted on : Monday, March 21, 2011 - 11:19:38 AM
Last modification on : Tuesday, October 23, 2018 - 2:36:09 PM
Document(s) archivé(s) le : Wednesday, June 22, 2011 - 9:54:28 AM

Files

CSDA.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00446520, version 2
  • ARXIV : 1103.4023

Citation

Nicolas Durrande, David Ginsbourger, Olivier Roustant. Additive Kernels for Gaussian Process Modeling. 2010, pp.17. ⟨hal-00446520v2⟩

Share

Metrics

Record views

554

Files downloads

259