767 articles – 1379 references  [version française]
HAL: hal-00695292, version 1

Detailed view  Export this paper
The Degrees of Freedom of the Group Lasso
Samuel Vaiter ( ) 1, Charles Deledalle 1, Gabriel Peyré 1, Jalal Fadili 2, Charles Dossal 3
(2012-05-07)

This paper studies the sensitivity to the observations of the block/group Lasso solution to an overdetermined linear regression model. Such a regularization is known to promote sparsity patterns structured as nonoverlapping groups of coefficients. Our main contribution provides a local parameterization of the solution with respect to the observations. As a byproduct, we give an unbiased estimate of the degrees of freedom of the group Lasso. Among other applications of such results, one can choose in a principled and objective way the regularization parameter of the Lasso through model selection criteria.
1:  CEntre de REcherches en MAthématiques de la DEcision (CEREMADE)
CNRS : UMR7534 – Université Paris IX - Paris Dauphine
2:  Groupe de Recherche en Informatique, Image, Automatique et Instrumentation de Caen (GREYC)
CNRS : UMR6072 – Université de Caen Basse-Normandie – Ecole Nationale Supérieure d'Ingénieurs de Caen
3:  Institut de Mathématiques de Bordeaux (IMB)
CNRS : UMR5251 – Université Sciences et Technologies - Bordeaux I – Université Victor Segalen - Bordeaux II
image
Mathematics/Statistics

Mathematics/Information Theory

Computer Science/Signal and Image Processing

Engineering Sciences/Signal and Image processing

Statistics/Statistics Theory

Computer Science/Information Theory and Coding
sparsity – group lasso – block regularization – local variation – degrees of freedom – unbiased risk estimation
Attached file list to this document: 
PDF
icml2012-vaiter-l1l2.pdf(131.4 KB)
PS
icml2012-vaiter-l1l2.ps(535.4 KB)