A Data-dependent Generalisation Error Bound for the AUC

Abstract : The optimisation of the Area Under the ROC Curve (AUC) has recently been proposed for learning ranking functions. However, the estimation of the AUC of a function on the true distribution of the examples based on its empirical value is still an open problem. In this paper, we present a data-dependent generalisation error bound for the AUC. This bound presents the advantage to be tight, but it also allows to draw practical conclusions on learning algorithms which optimise the AUC. In particular, we show that in the case of AUC, kernel function classes have strong generalisation guarantees provided that the weights of the functions are small, suggesting that regularisation procedures which tend to limit the norm of the weight vector may lead to better generalisation performance for algorithms which optimise the AUC.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-01416673
Contributor : Lip6 Publications <>
Submitted on : Wednesday, December 14, 2016 - 4:59:26 PM
Last modification on : Thursday, March 21, 2019 - 12:58:56 PM

Identifiers

  • HAL Id : hal-01416673, version 1

Citation

Nicolas Usunier, Massih-Reza Amini, Patrick Gallinari. A Data-dependent Generalisation Error Bound for the AUC. ICML'05 workshop on ROC Analysis in Machine Learning, Aug 2005, Bonn, Germany. ⟨hal-01416673⟩

Share

Metrics

Record views

60