# Hierarchical clustering with discrete latent variable models and the integrated classification likelihood

5 MAASAI - Modèles et algorithmes pour l’intelligence artificielle
CRISAM - Inria Sophia Antipolis - Méditerranée , Laboratoire I3S - SPARKS - Scalable and Pervasive softwARe and Knowledge Systems, UNS - Université Nice Sophia Antipolis (... - 2019), JAD - Laboratoire Jean Alexandre Dieudonné
Abstract : In this paper, we introduce a two step methodology to extract a hierarchical clustering. This methodology considers the integrated classification likelihood criterion as an objective function, and applies to any discrete latent variable models (DLVM) where this quantity is tractable. The first step of the methodology involves maximizing the criterion with respect to the discrete latent variables state with uninformative priors. To that end we propose a new hybrid algorithm based on greedy local searches as well as a genetic algorithm which allows the joint inference of the number $K$ of clusters and of the clusters themselves. The second step of the methodology is based on a bottom-up greedy procedure to extract a hierarchy of clusters from this natural partition. In a Bayesian context, this is achieved by considering the Dirichlet cluster proportion prior parameter $\alpha$ as a regularisation term controlling the granularity of the clustering. This second step allows the exploration of the clustering at coarser scales and the ordering of the clusters an important output for the visual representations of the clustering results. The clustering results obtained with the proposed approach, on simulated as well as real settings, are compared with existing strategies and are shown to be particularly relevant. This work is implemented in the R package greed.
Keywords :
Document type :
Journal articles
Domain :

https://hal.archives-ouvertes.fr/hal-02530705
Contributor : Charles Bouveyron <>
Submitted on : Friday, April 3, 2020 - 10:45:18 AM
Last modification on : Saturday, April 24, 2021 - 3:32:54 AM

### Identifiers

• HAL Id : hal-02530705, version 1
• ARXIV : 2002.11577

### Citation

Etienne Côme, Pierre Latouche, Nicolas Jouvin, Charles Bouveyron. Hierarchical clustering with discrete latent variable models and the integrated classification likelihood. Advances in Data Analysis and Classification, Springer Verlag, In press. ⟨hal-02530705⟩

Record views