Skip to Main content Skip to Navigation
Conference papers

Ranking with ordered weighted pairwise classification

Nicolas Usunier 1 David Buffoni 1 Patrick Gallinari 1 
1 MALIRE - Machine Learning and Information Retrieval
LIP6 - Laboratoire d'Informatique de Paris 6
Abstract : In ranking with the pairwise classification approach, the loss associated to a predicted ranked list is the mean of the pairwise classification losses. This loss is inadequate for tasks like information retrieval where we prefer ranked lists with high precision on the top of the list. We propose to optimize a larger class of loss functions for ranking, based on an ordered weighted average (OWA) (Yager, 1988) of the classification losses. Convex OWA aggregation operators range from the max to the mean depending on their weights, and can be used to focus on the top ranked elements as they give more weight to the largest losses. When aggregating hinge losses, the optimization problem is similar to the SVM for interdependent output spaces. Moreover, we show that OWA aggregates of margin-based classification losses have good generalization properties. Experiments on the Letor 3.0 benchmark dataset for information retrieval validate our approach.
Document type :
Conference papers
Complete list of metadata
Contributor : Lip6 Publications Connect in order to contact the contributor
Submitted on : Tuesday, April 5, 2016 - 11:06:22 AM
Last modification on : Wednesday, January 12, 2022 - 3:47:22 AM



Nicolas Usunier, David Buffoni, Patrick Gallinari. Ranking with ordered weighted pairwise classification. International Conference on Machine Learning, Jun 2009, Montreal, Quebec, Canada. pp.1057-1064, ⟨10.1145/1553374.1553509⟩. ⟨hal-01297974⟩



Record views