How Correlations Influence Lasso Prediction

Mohamed Hebiri (1) , Johannes C. Lederer (2)

1 LAMA - Laboratoire d'Analyse et de Mathématiques Appliquées
2 Seminar für Statistik

We study how correlations in the design matrix influence Lasso prediction. First, we argue that the higher the correlations are, the smaller the optimal tuning parameter is. This implies in particular that the standard tuning parameters, that do not depend on the design matrix, are not favorable. Furthermore, we argue that Lasso prediction works well for any degree of correlations if suitable tuning parameters are chosen. We study these two subjects theoretically as well as with simulations.

Mots clés: Correlations; Lars Algorithm; Lasso; Restricted Eigenvalue; Tuning Parameter

Domaines: Statistiques [math.ST]; Théorie [stat.TH]

Mohamed Hebiri, Johannes C. Lederer. How Correlations Influence Lasso Prediction. 2012. ⟨hal-00686055v2⟩