Skip to Main content Skip to Navigation
Preprints, Working Papers, ...

Clustering with missing data: which equivalent for Rubin's rules?

Vincent Audigier 1 Ndèye Niang 1
1 CEDRIC - MSDMA - CEDRIC. Méthodes statistiques de data-mining et apprentissage
CEDRIC - Centre d'études et de recherche en informatique et communications
Abstract : Multiple imputation (MI) is a popular method for dealing with missing values. However, the suitable way for applying clustering after MI remains unclear: how to pool partitions? How to assess the clustering instability when data are incomplete? By answering both questions, this paper proposed a complete view of clustering with missing data using MI. The problem of partitions pooling is here addressed using consensus clustering while, based on the bootstrap theory, we explain how to assess the instability related to observed and missing data. The new rules for pooling partitions and instability assessment are theoretically argued and extensively studied by simulation. Partitions pooling improves accuracy while measuring instability with missing data enlarges the data analysis possibilities: it allows assessment of the dependence of the clustering to the imputation model, as well as a convenient way for choosing the number of clusters when data are incomplete, as illustrated on a real data set.
Document type :
Preprints, Working Papers, ...
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03030395
Contributor : Vincent Audigier Connect in order to contact the contributor
Submitted on : Monday, November 30, 2020 - 9:30:25 AM
Last modification on : Tuesday, March 23, 2021 - 11:00:03 AM

Links full text

Identifiers

  • HAL Id : hal-03030395, version 1
  • ARXIV : 2011.13694

Citation

Vincent Audigier, Ndèye Niang. Clustering with missing data: which equivalent for Rubin's rules?. 2020. ⟨hal-03030395⟩

Share

Metrics

Record views

92