Active evidential calibration of binary SVM classifiers

Frédéric Pichon (1) , Sébastien Ramel (1) , François Delmotte (1)

1 LGI2A - Laboratoire de Génie Informatique et d'Automatique de l'Artois

Evidential calibration methods of binary classifiers improve upon probabilistic calibration methods by representing explicitly the calibration uncertainty due to the amount of training (labelled) data. This justified yet undesirable uncertainty can be reduced by adding training data, which are in general costly. Hence the need for strategies that, given a pool of unlabelled data, will point to interesting data to be labelled, i.e., to data inducing a drop in uncertainty greater than a random selection. Two such strategies are considered in this paper and applied to an ensemble of binary SVM classifiers on some classical binary classification datasets. Experimental results show the interest of the approach.

Mots clés: belief functions; evidential calibration; active learning

Domaines: Intelligence artificielle [cs.AI]

Frédéric Pichon, Sébastien Ramel, François Delmotte. Active evidential calibration of binary SVM classifiers. BELIEF 2018, Sep 2018, Compiègne, France. pp.208-216. ⟨hal-03521899⟩