940 articles – 1212 references  [version française]
HAL: hal-00512304, version 2

Detailed view  Export this paper
Available versions:
Optimal upper and lower bounds for the true and empirical excess risks in heteroscedastic least-squares regression
Adrien Saumard 1, 2
(2010-08-29)

We consider the estimation of a bounded regression function with nonparametric heteroscedastic noise. We are interested by the true and empirical excess risks of the least-squares estimator on a …nite-dimensional vector space. For these quantities, we give upper and lower bounds in probability that are optimal at the …rst order. Moreover, these bounds show the equivalence between the true and empirical excess risks when, among other things, the least-squares estimator is consistent in sup-norm towards the projection of the regression function onto the considered model. Consistency in sup-norm is then proved for suitable histogram models and more general models of piecewise polynomials that are endowed with a localized basis structure.
1:  Institut de Recherche Mathématique de Rennes (IRMAR)
CNRS : UMR6625 – Université de Rennes 1 – École normale supérieure de Cachan - ENS Cachan – Institut National des Sciences Appliquées (INSA) : - RENNES – Université de Rennes II - Haute Bretagne
2:  SELECT (INRIA Saclay - Ile de France)
INRIA – Université Paris XI - Paris Sud – CNRS : UMR
Statistics/Other Statistics
Least-squares regression – Heteroscedasticity – Excess risk – Lower bounds – Empirical process – M-estimation
Attached file list to this document: 
PDF
Regression_fixed_model_case_3.pdf(427.8 KB)