Generalized Measures for the Evaluation of Community Detection Methods

Abstract : Community detection can be considered as a variant of cluster analysis applied to complex networks. For this reason, all existing studies have been using tools derived from this field when evaluating community detection algorithms. However, those are not completely relevant in the context of network analysis, because they ignore an essential part of the available information: the network structure. Therefore, they can lead to incorrect interpretations. In this article, we review these measures, and illustrate this limitation. We propose a modification to solve this problem, and apply it to the three most widespread measures: purity, Rand index and normalized mutual information (NMI). We then perform an experimental evaluation on artificially generated networks with realistic community structure. We assess the relevance of the modified measures by comparison with their traditional counterparts, and also relatively to the topological properties of the community structures. On these data, the modified NMI turns out to provide the most relevant results.
Complete list of metadatas

Cited literature [25 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-00802923
Contributor : Vincent Labatut <>
Submitted on : Friday, May 13, 2016 - 5:22:16 PM
Last modification on : Saturday, March 23, 2019 - 1:22:37 AM
Long-term archiving on : Wednesday, November 16, 2016 - 4:57:26 AM

File

Labatut2015.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution - NonCommercial - NoDerivatives 4.0 International License

Identifiers

Collections

Citation

Vincent Labatut. Generalized Measures for the Evaluation of Community Detection Methods. International Journal of Social Network Analysis and Mining (SNAM), 2015, 2 (1), pp.44-63. ⟨http://www.inderscience.com/info/inarticle.php?artid=69776⟩. ⟨10.1504/IJSNM.2015.069776⟩. ⟨hal-00802923v2⟩

Share

Metrics

Record views

251

Files downloads

420