Skip to Main content Skip to Navigation
Journal articles

Rank aggregation with ties: Experiments and Analysis

Abstract : The problem of aggregating multiple rankings into one consensus ranking is an active research topic especially in the database community. Various studies have implemented methods for rank aggregation and may have come up with contradicting conclusions upon which algorithms work best. Comparing such results is cumbersome, as the original studies mixed di erent approaches and used very di erent evaluation datasets and metrics. Additionally, in real applications, the rankings to be aggregated may not be permutations where elements are strictly ordered, but they may have ties where some elements are placed at the same position. However, most of the studies have not considered ties. This paper introduces the rst large scale study of algorithms for rank aggregation with ties. More precisely, (i) we review rank aggregation algorithms and determine whether or not they can handle ties; (ii) we propose the first implementation to compute the exact solution of the Rank Aggregation with ties problem; (iii) we evaluate algorithms for rank aggregation with ties on a very large panel of both real and carefully generated synthetic datasets; (iv) we provide guidance on the algorithms to be favored depending on dataset features.
Complete list of metadatas

Cited literature [35 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01165336
Contributor : Sarah Cohen-Boulakia <>
Submitted on : Sunday, July 5, 2015 - 10:32:20 PM
Last modification on : Wednesday, June 3, 2020 - 3:49:33 AM
Document(s) archivé(s) le : Wednesday, April 26, 2017 - 12:27:45 AM

File

p1202-brancotte.pdf
Publisher files allowed on an open archive

Identifiers

Citation

Bryan Brancotte, Bo Yang, Guillaume Blin, Sarah Cohen-Boulakia, Alain Denise, et al.. Rank aggregation with ties: Experiments and Analysis. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, Proceedings of the VLDB Endowment (PVLDB), 8 (11), pp.1202-1213. ⟨10.14778/2809974.2809982⟩. ⟨hal-01165336⟩

Share

Metrics

Record views

1938

Files downloads

810