Joint rank and variable selection for parsimonious estimation in high-dimension finite mixture regression model.

Emilie Devijver (1, 2)

1 SELECT - Model selection in statistical learning
2 LM-Orsay - Laboratoire de Mathématiques d'Orsay

We study a dimension reduction method for finite mixture of mul-tivariate response regression models in high dimension. Both the number of responses and of predictors may exceed the sample size. We consider jointly predictor selection and rank reduction for obtaining lower-dimensional approx-imations of parameter matrices. This methodology was already developed in [8]. In this paper, we prove that these estimators are adaptive to the unknown matrix sparsity. More precisely, we exhibit a penalty for which the model se-lected by the penalized likelihood satisfies an oracle inequality. We support our theoretical result with simulation study and data analysis.

Domaines: Statistiques [math.ST]

Emilie Devijver. Joint rank and variable selection for parsimonious estimation in high-dimension finite mixture regression model.. 2015. ⟨hal-01099296v1⟩