PAC-Bayesian Generalization Bound on Confusion Matrix for Multi-Class Classification

Abstract : In this work, we propose a PAC-Bayes bound for the generalization risk of the Gibbs classifier in the multi-class classification framework. The novelty of our work is the critical use of the confusion matrix of a classifier as an error measure; this puts our contribution in the line of work aiming at dealing with performance measure that are richer than mere scalar criterion such as the misclassification rate. Thanks to very recent and beautiful results on matrix concentration inequalities, we derive two bounds showing that the true confusion risk of the Gibbs classifier is upper-bounded by its empirical risk plus a term depending on the number of training examples in each class. To the best of our knowledge, this is the first PAC-Bayes bounds based on confusion matrices.
Document type :
Conference papers
Complete list of metadatas

https://hal.archives-ouvertes.fr/hal-00674847
Contributor : Emilie Morvant <>
Submitted on : Tuesday, October 22, 2013 - 10:06:39 AM
Last modification on : Tuesday, April 2, 2019 - 1:42:41 AM
Long-term archiving on : Friday, April 7, 2017 - 2:33:26 PM

Files

main_multibayes.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-00674847, version 6
  • ARXIV : 1202.6228

Citation

Emilie Morvant, Sokol Koço, Liva Ralaivola. PAC-Bayesian Generalization Bound on Confusion Matrix for Multi-Class Classification. International Conference on Machine Learning (ICML), Jun 2012, Edinburgh, United Kingdom. ⟨hal-00674847v6⟩

Share

Metrics

Record views

474

Files downloads

205