Service interruption on Monday 11 July from 12:30 to 13:00: all the sites of the CCSD (HAL, EpiSciences, SciencesConf, AureHAL) will be inaccessible (network hardware connection).
Skip to Main content Skip to Navigation
Journal articles

Rank aggregation with ties: Experiments and Analysis

Abstract : The problem of aggregating multiple rankings into one consensus ranking is an active research topic especially in the database community. Various studies have implemented methods for rank aggregation and may have come up with contradicting conclusions upon which algorithms work best. Comparing such results is cumbersome, as the original studies mixed di erent approaches and used very di erent evaluation datasets and metrics. Additionally, in real applications, the rankings to be aggregated may not be permutations where elements are strictly ordered, but they may have ties where some elements are placed at the same position. However, most of the studies have not considered ties. This paper introduces the rst large scale study of algorithms for rank aggregation with ties. More precisely, (i) we review rank aggregation algorithms and determine whether or not they can handle ties; (ii) we propose the first implementation to compute the exact solution of the Rank Aggregation with ties problem; (iii) we evaluate algorithms for rank aggregation with ties on a very large panel of both real and carefully generated synthetic datasets; (iv) we provide guidance on the algorithms to be favored depending on dataset features.
Complete list of metadata

Cited literature [35 references]  Display  Hide  Download
Contributor : Sarah Cohen-Boulakia Connect in order to contact the contributor
Submitted on : Sunday, July 5, 2015 - 10:32:20 PM
Last modification on : Tuesday, July 5, 2022 - 10:05:49 AM
Long-term archiving on: : Wednesday, April 26, 2017 - 12:27:45 AM


Publisher files allowed on an open archive



Bryan Brancotte, Bo yang, Guillaume Blin, Sarah Cohen-Boulakia, Alain Denise, et al.. Rank aggregation with ties: Experiments and Analysis. Proceedings of the VLDB Endowment (PVLDB), VLDB Endowment, 2015, Proceedings of the VLDB Endowment (PVLDB), 8 (11), pp.1202-1213. ⟨10.14778/2809974.2809982⟩. ⟨hal-01165336⟩



Record views


Files downloads