Stability of feature selection in classification issues for high-dimensional correlated data

Abstract : Handling dependence or not in feature selection is still an open question in supervised classification issues where the number of covariates exceeds the number of observations. Some recent papers surprisingly show the superiority of naive Bayes approaches based on an obviously erroneous assumption of independence, whereas others recommend to infer on the dependence structure in order to decorrelate the selection statistics. In the classical linear discriminant analysis (LDA) framework, the present paper first highlights the impact of dependence in terms of instability of feature selection. A second objective is to revisit the above issue using a flexible factor modeling for the covariance. This framework introduces latent components of dependence, conditionally on which a new Bayes consistency is defined. A procedure is then proposed for the joint estimation of the expectation and variance parameters of the model. The present method is compared to recent regularized diagonal discriminant analysis approaches, assuming independence among features, and regularized LDA procedures, both in terms of classification performance and stability of feature selection. The proposed method is implemented in the R package FADA, freely available from the R repository CRAN.
Type de document :
Article dans une revue
Statistics and Computing, Springer Verlag (Germany), 2016, 26 (4), pp.783-796. 〈10.1007/s11222-015-9569-2〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01256508
Contributeur : Chloé Friguet <>
Soumis le : vendredi 15 janvier 2016 - 00:24:49
Dernière modification le : samedi 23 septembre 2017 - 01:08:22

Identifiants

Citation

Emeline Perthame, Chloé Friguet, David Causeur. Stability of feature selection in classification issues for high-dimensional correlated data. Statistics and Computing, Springer Verlag (Germany), 2016, 26 (4), pp.783-796. 〈10.1007/s11222-015-9569-2〉. 〈hal-01256508〉

Partager

Métriques

Consultations de la notice

477