Transductive Bounds for the Multi-class Majority Vote Classifier

Abstract : In this paper, we propose a transductive bound over the risk of the majority vote classifier learned with partially labeled data for the multi-class classification. The bound is obtained by considering the class confusion matrix as an error indicator and it involves the margin distribution of the classifier over each class and a bound over the risk of the associated Gibbs classifier. When this latter bound is tight and, the errors of the majority vote classifier per class are concentrated on a low margin zone; we prove that the bound over the Bayes classifier' risk is tight. As an application, we extend the self-learning algorithm to the multi-class case. The algorithm iteratively assigns pseudo-labels to a subset of unlabeled training examples that have their associated class margin above a threshold obtained from the proposed transductive bound. Empirical results on different data sets show the effectiveness of our approach compared to the same algorithm where the threshold is fixed manually, to the extension of TSVM to multi-class classification and to a graph-based semi-supervised algorithm.
Document type :
Preprints, Working Papers, ...
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01980449
Contributor : Vasilii Feofanov <>
Submitted on : Monday, January 14, 2019 - 2:19:02 PM
Last modification on : Tuesday, February 12, 2019 - 11:28:01 AM

File

feofanov-devijver-amini-transd...
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01980449, version 1

Collections

LIG | UGA

Citation

Vasilii Feofanov, Emilie Devijver, Massih-Reza Amini. Transductive Bounds for the Multi-class Majority Vote Classifier. 2019. ⟨hal-01980449⟩

Share

Metrics

Record views

36

Files downloads

30