Regularity dependence of the rate of convergence of the learning curve for Gaussian process regression

Abstract : This paper deals with the speed of convergence of the learning curve in a Gaussian process regression framework. The learning curve describes the average generalization error of the Gaussian process used for the regression. More specifically, it is defined in this paper as the integral of the mean squared error over the input parameter space with respect to the probability measure of the input parameters. The main result is the proof of a theorem giving the mean squared error in function of the number of observations for a large class of kernels and for any dimension when the number of observations is large. From this result, we can deduce the asymptotic behavior of the generalization error. The presented proof generalizes previous ones that were limited to more specific kernels or to small dimensions (one or two). The result can be used to build an optimal strategy for resources allocation. This strategy is applied successfully to a nuclear safety problem.
Document type :
Preprints, Working Papers, ...
Liste complète des métadonnées

Cited literature [24 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00737342
Contributor : Loic Le Gratiet <>
Submitted on : Thursday, January 10, 2013 - 4:00:54 PM
Last modification on : Sunday, March 31, 2019 - 1:37:46 AM
Document(s) archivé(s) le : Thursday, April 11, 2013 - 4:06:49 AM

Files

Convergence_BLUP_arxiv.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00737342, version 3
  • ARXIV : 1210.2879

Citation

Loic Le Gratiet, Josselin Garnier. Regularity dependence of the rate of convergence of the learning curve for Gaussian process regression. 2012. ⟨hal-00737342v3⟩

Share

Metrics

Record views

490

Files downloads

407