Intrinsic Dimension Estimation by Maximum Likelihood in Isotropic Probabilistic PCA

Charles Bouveyron 1 Gilles Celeux 2 Stephane Girard 3
2 SELECT - Model selection in statistical learning
Inria Saclay - Ile de France, LMO - Laboratoire de Mathématiques d'Orsay, CNRS - Centre National de la Recherche Scientifique : UMR
3 MISTIS - Modelling and Inference of Complex and Structured Stochastic Systems
Inria Grenoble - Rhône-Alpes, LJK - Laboratoire Jean Kuntzmann, INPG - Institut National Polytechnique de Grenoble
Abstract : A central issue in dimension reduction is choosing a sensible number of dimensions to be retained. This work demonstrates the surprising result of the asymptotic consistency of the maximum likelihood criterion for determining the intrinsic dimension of a dataset in an isotropic version of Probabilistic Principal Component Analysis (PPCA). Numerical experiments on simulated and real datasets show that the maximum likelihood criterion can actually be used in practice and outperforms existing intrinsic dimension selection criteria in various situations. This paper exhibits and outlines the limits of the maximum likelihood criterion. It leads to recommend the use of the AIC criterion in specific situations. A useful application of this work would be the automatic selection of intrinsic dimensions in mixtures of isotropic PPCA for classification.
Type de document :
Article dans une revue
Pattern Recognition Letters, Elsevier, 2011, 32 (14), pp.1706-1713. 〈10.1016/j.patrec.2011.07.017〉
Liste complète des métadonnées

Littérature citée [33 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-00440372
Contributeur : Charles Bouveyron <>
Soumis le : lundi 11 juillet 2011 - 09:35:22
Dernière modification le : vendredi 24 novembre 2017 - 13:30:32
Document(s) archivé(s) le : mercredi 12 octobre 2011 - 02:21:13

Fichier

revision_PPCAds.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Collections

Citation

Charles Bouveyron, Gilles Celeux, Stephane Girard. Intrinsic Dimension Estimation by Maximum Likelihood in Isotropic Probabilistic PCA. Pattern Recognition Letters, Elsevier, 2011, 32 (14), pp.1706-1713. 〈10.1016/j.patrec.2011.07.017〉. 〈hal-00440372v3〉

Partager

Métriques

Consultations de la notice

1004

Téléchargements de fichiers

311