Similarity Based Hierarchical Clustering with an Application to Text Collections

Abstract : Lance-Williams formula is a framework that unifies seven schemes of agglomerative hierarchical clustering. In this paper, we establish a new expression of this formula using cosine similarities instead of distances. We state conditions under which the new formula is equivalent to the original one. The interest of our approach is twofold. Firstly, we can naturally extend agglomerative hierarchical clustering techniques to kernel functions. Secondly, reasoning in terms of similarities allows us to design thresholding strategies on proximity values. Thereby, we propose to sparsify the similarity matrix in the goal of making these clustering techniques more efficient. We apply our approach to text clustering tasks. Our results show that sparsifying the inner product matrix considerably decreases memory usage and shortens running time while assuring the clustering quality.
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01437124
Contributor : Xinyu Wang <>
Submitted on : Monday, April 10, 2017 - 5:05:47 PM
Last modification on : Wednesday, November 20, 2019 - 3:09:30 AM
Long-term archiving on: Tuesday, July 11, 2017 - 12:16:43 PM

File

paper_ida_16.pdf
Files produced by the author(s)

Licence


Copyright

Identifiers

Collections

Citation

Julien Ah-Pine, Xinyu Wang. Similarity Based Hierarchical Clustering with an Application to Text Collections. Intelligent Data Analysis, Oct 2016, Stockholm, Sweden. pp.320 - 331, ⟨10.1007/978-3-319-46349-0⟩. ⟨hal-01437124⟩

Share

Metrics

Record views

131

Files downloads

219