EK-NNclus: A clustering procedure based on the evidential K-nearest neighbor rule

Thierry Denoeux (1, 2) , Orakanya Kanjanatarakul (1, 2) , Songsak Sriboonchitta (3)

1 Labex MS2T - Laboratoire d'Excellence "Maîtrise des Systèmes de Systèmes Technologiques"
2 Heudiasyc - Heuristique et Diagnostic des Systèmes Complexes [Compiègne]
3 CMU - Chiang Mai University

We propose a new clustering algorithm based on the evidential K nearest-neighbor (EK-NN) rule. Starting from an initial partition, the algorithm, called EK-NNclus, iteratively reassigns objects to clusters using the EK-NN rule, until a stable partition is obtained. After convergence, the cluster membership of each object is described by a Dempster-Shafer mass function assigning a mass to each cluster and to the whole set of clusters. The mass assigned to the set of clusters can be used to identify outliers. The method can be implemented in a competitive Hopfield neural network, whose energy function is related to the plausibility of the partition. The procedure can thus be seen as searching for the most plausible partition of the data. The EK-NNclus algorithm can be set up to depend on two parameters, the number K of neighbors and a scale parameter, which can be fixed using simple heuristics. The number of clusters does not need to be determined in advance. Numerical experiments with a variety of datasets show that the method generally performs better than density-based and model-based procedures for finding a partition with an unknown number of clusters.

Mots clés: Dempster-Shafer Theory; Evidence Theory; Hopfield neural networks; Unsupervised learning; Credal partition

Domaines: Intelligence artificielle [cs.AI]

Thierry Denoeux, Orakanya Kanjanatarakul, Songsak Sriboonchitta. EK-NNclus: A clustering procedure based on the evidential K-nearest neighbor rule. Knowledge-Based Systems, 2015, 88, pp.57-69. ⟨10.1016/j.knosys.2015.08.007⟩. ⟨hal-01294267⟩