Warped bases for conditional density estimation

Abstract : We consider the problem of estimating the conditional density $\pi$ of a response vector $Y$ given the predictor $X$ (which is assumed to be a continuous variable). We provide an adaptive nonparametric strategy to estimate $\pi$, based on model selection. We start with a collection of finite dimensional product spaces, spanned by orthonormal bases. But instead of expanding directly the target function $\pi$ on these bases, we prefer to consider the expansion of $h(x,y)=\pi(F_X^{-1}(x),y)$, where $F_X$ is the cumulative distribution function of the variable $X$. This 'warping' of the bases allows us to propose a family of projection estimators easier to compute than estimators resulting from the minimization of a regression-type contrast. The data-driven selection of the best estimator $\hat{h}$ for the function $h$, is done with a model selection device in the spirit of Goldenshluger and Lepski (2011). The resulting estimator is $\hat{\pi}(x,y)=\hat{h}(\hat{F}(x),y)$ otherwise, where $\hat{F}$ is the empirical distribution function. We prove that it realises a global squared-bias/variance compromise, in a context of anisotropic function classes: we establish non-asymptotic mean-squared integrated risk bounds and also provide risk convergence rates. Simulation experiments illustrate the method.
Type de document :
Pré-publication, Document de travail
MAP5 2011-30. 2012
Liste complète des métadonnées

Contributeur : Gaëlle Chagny <>
Soumis le : mardi 26 juin 2012 - 10:53:03
Dernière modification le : mardi 11 octobre 2016 - 14:59:47
Document(s) archivé(s) le : jeudi 27 septembre 2012 - 02:35:17


Fichiers produits par l'(les) auteur(s)


  • HAL Id : hal-00641560, version 2



Gaëlle Chagny. Warped bases for conditional density estimation. MAP5 2011-30. 2012. <hal-00641560v2>



Consultations de
la notice


Téléchargements du document