Model selection and estimation of a component in additive regression

Abstract : Let $Y\in\R^n$ be a random vector with mean $s$ and covariance matrix $\sigma^2P_n\tra{P_n}$ where $P_n$ is some known $n\times n$-matrix. We construct a statistical procedure to estimate $s$ as well as under moment condition on $Y$ or Gaussian hypothesis. Both cases are developed for known or unknown $\sigma^2$. Our approach is free from any prior assumption on $s$ and is based on non-asymptotic model selection methods. Given some linear spaces collection $\{S_m,\ m\in\M\}$, we consider, for any $m\in\M$, the least-squares estimator $\hat{s}_m$ of $s$ in $S_m$. Considering a penalty function that is not linear to the dimensions of the $S_m$'s, we select some $\hat{m}\in\M$ in order to get an estimator $\hat{s}_{\hat{m}}$ with a quadratic risk as close as possible to the minimal one among the risks of the $\hat{s}_m$'s. Non-asymptotic oracle-type inequalities and minimax convergence rates are proved for $\hat{s}_{\hat{m}}$. A special attention is given to the estimation of a non-parametric component in additive models. Finally, we carry out a simulation study in order to illustrate the performances of our estimators in practice.
Document type :
Journal articles
Complete list of metadatas

Cited literature [17 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01597060
Contributor : Xavier Gendre <>
Submitted on : Friday, February 22, 2019 - 11:11:05 AM
Last modification on : Friday, April 12, 2019 - 4:22:52 PM
Long-term archiving on : Thursday, May 23, 2019 - 2:24:08 PM

File

Gendre_22773.pdf
Files produced by the author(s)

Identifiers

Citation

Xavier Gendre. Model selection and estimation of a component in additive regression. ESAIM: Probability and Statistics, EDP Sciences, 2014, 18, pp.77-116. ⟨10.1051/ps/2012028⟩. ⟨hal-01597060⟩

Share

Metrics

Record views

120

Files downloads

69