HAL will be down for maintenance from Friday, June 10 at 4pm through Monday, June 13 at 9am. More information
Skip to Main content Skip to Navigation
Journal articles

Robust Regression through the Huber's criterion and adaptive lasso penalty

Sophie Lambert-Lacroix 1 Laurent Zwald 2, 3
1 TIMC-IMAG-BCM - Biologie Computationnelle et Mathématique
TIMC-IMAG - Techniques de l'Ingénierie Médicale et de la Complexité - Informatique, Mathématiques et Applications, Grenoble - UMR 5525
2 LEAR - Learning and recognition in vision
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, Grenoble INP - Institut polytechnique de Grenoble - Grenoble Institute of Technology
3 SAM - Statistique Apprentissage Machine
LJK - Laboratoire Jean Kuntzmann
Abstract : The Huber's Criterion is a useful method for robust regression. The adaptive least absolute shrinkage and selection operator (lasso) is a popular technique for simultaneous estimation and variable selection. The adaptive weights in the adaptive lasso allow to have the oracle properties. In this paper we propose to combine the Huber's criterion and adaptive penalty as lasso. This regression technique is resistant to heavy-tailed er- rors or outliers in the response. Furthermore, we show that the estimator associated with this procedure enjoys the oracle properties. This approach is compared with LAD-lasso based on least absolute deviation with adaptive lasso. Extensive simulation studies demonstrate satisfactory finite-sample performance of such procedure. A real example is analyzed for illustration purposes.
Complete list of metadata

Cited literature [37 references]  Display  Hide  Download

Contributor : Laurent Zwald Connect in order to contact the contributor
Submitted on : Friday, January 20, 2012 - 6:14:44 PM
Last modification on : Wednesday, February 2, 2022 - 12:30:01 PM
Long-term archiving on: : Saturday, April 21, 2012 - 2:41:41 AM


Files produced by the author(s)



Sophie Lambert-Lacroix, Laurent Zwald. Robust Regression through the Huber's criterion and adaptive lasso penalty. Electronic Journal of Statistics , Shaker Heights, OH : Institute of Mathematical Statistics, 2011, 5, pp.1015-1053. ⟨10.1214/11-EJS635⟩. ⟨hal-00661864⟩



Record views


Files downloads