Calibration and regret bounds for order-preserving surrogate losses in learning to rank - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Machine Learning Année : 2013

Calibration and regret bounds for order-preserving surrogate losses in learning to rank

Résumé

Learning to rank is usually reduced to learning to score individual objects, leaving the "ranking" step to a sorting algorithm. In that context, the surrogate loss used for training the scoring function needs to behave well with respect to the target performance measure which only sees the final ranking. A characterization of such a good behavior is the notion of calibration, which guarantees that minimizing (over the set of measurable functions) the surrogate risk allows us to maximize the true performance. In this paper, we consider the family of order-preserving (OP) losses which includes popular surrogate losses for ranking such as the squared error and pairwise losses. We show that they are calibrated with performance measures like the Discounted Cumulative Gain (DCG), but also that they are not calibrated with respect to the widely used Mean Average Precision and Expected Reciprocal Rank. We also derive, for some widely used OP losses, quantitative surrogate regret bounds with respect to several DCG-like evaluation measures.
Fichier principal
Vignette du fichier
final_main.pdf (713.63 Ko) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-00834230 , version 1 (14-06-2013)

Identifiants

Citer

Clément Calauzènes, Nicolas Usunier, Patrick Gallinari. Calibration and regret bounds for order-preserving surrogate losses in learning to rank. Machine Learning, 2013, 93 (2-3), pp.227-260. ⟨10.1007/s10994-013-5382-3⟩. ⟨hal-00834230⟩
256 Consultations
305 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More