Skip to Main content Skip to Navigation
Journal articles

Theoretical and practical considerations on the convergence properties of the Fisher-EM algorithm

Abstract : The Fisher-EM algorithm has been recently proposed in (Bouveyron2011) for the simultaneous visualization and clustering of high-dimensional data. It is based on a latent mixture model which fits the data into a latent discriminative subspace with a low intrinsic dimension. Although the Fisher-EM algorithm is based on the EM algorithm, it does not respect at a first glance all conditions of the EM convergence theory. Its convergence toward a maximum of the likelihood is therefore questionable. The aim of this work is two folds. Firstly, the convergence of the Fisher-EM algorithm is studied from the theoretical point of view. It is in particular proved that the algorithm converges under weak conditions in the general case. Secondly, the convergence of the Fisher-EM algorithm is considered from the practical point of view. It is shown that the Fisher's criterion can be used as stopping criterion for the algorithm to improve the clustering accuracy. It is also shown that the Fisher-EM algorithm converges faster than both the EM and CEM algorithm.
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00633744
Contributor : Charles Bouveyron <>
Submitted on : Wednesday, October 19, 2011 - 12:09:30 PM
Last modification on : Sunday, January 19, 2020 - 6:38:32 PM
Long-term archiving on: : Friday, January 20, 2012 - 10:26:54 AM

File

convergenceFEM.pdf
Files produced by the author(s)

Identifiers

Citation

Charles Bouveyron, Camille Brunet. Theoretical and practical considerations on the convergence properties of the Fisher-EM algorithm. Journal of Multivariate Analysis, Elsevier, 2012, 109, pp.29-41. ⟨10.1016/j.jmva.2012.02.012⟩. ⟨hal-00633744⟩

Share

Metrics

Record views

739

Files downloads

1336