Combination of classifiers with optimal weight based on evidential reasoning

Abstract : In pattern classification problem, different classifiers learnt using different training data can provide more or less complementary knowledge, and the combination of classifiers is expected to improve the classification accuracy. Evidential reasoning (ER) provides an efficient framework to represent and combine the imprecise and uncertain information. In this work, we want to focus on the weighted combination of classifiers based on ER. Because each classifier may have different performance on the given data set, the classifiers to combine are considered with different weights. A new weighted classifier combination method is proposed based on ER to enhance the classification accuracy. The optimal weighting factors of classifiers are obtained by minimizing the distances between fusion results obtained by Dempster's rule and the target output in training data space to fully take advantage of the complementarity of the classifiers. A confusion matrix is additionally introduced to characterize the probability of the object belonging to one class but classified to another class by the fusion result. This matrix is also optimized using training data jointly with classifier weight, and it is used to modify the fusion result to make it as close as possible to truth. Moreover, the training patterns are considered with different weights for the parameter optimization in classifier fusion, and the patterns hard to classify are committed with bigger weight than the ones easy to deal with. The pattern weight and the other parameters (i.e. classifier weight and confusion matrix) are iteratively optimized for obtaining the highest classification accuracy. A cautious decision making strategy is introduced to reduce the errors, and the pattern hard to classify will be cautiously committed to a set of classes, because the partial imprecision of decision is considered better than error in certain case. The effectiveness of the proposed method is demonstrated with various real data sets from UCI repository, and its performances are compared with those of other classical methods.
Type de document :
Article dans une revue
IEEE Transactions on Fuzzy Systems, Institute of Electrical and Electronics Engineers, 2017, 〈10.1109/TFUZZ.2017.2718483〉
Liste complète des métadonnées

Littérature citée [44 références]  Voir  Masquer  Télécharger

https://hal.archives-ouvertes.fr/hal-01588701
Contributeur : Arnaud Martin <>
Soumis le : samedi 16 septembre 2017 - 17:13:15
Dernière modification le : mercredi 20 septembre 2017 - 01:09:02

Fichier

FinalVersion.pdf
Fichiers produits par l'(les) auteur(s)

Identifiants

Citation

Zhun-Ga Liu, Quan Pan, Jean Dezert, Arnaud Martin. Combination of classifiers with optimal weight based on evidential reasoning. IEEE Transactions on Fuzzy Systems, Institute of Electrical and Electronics Engineers, 2017, 〈10.1109/TFUZZ.2017.2718483〉. 〈hal-01588701〉

Partager

Métriques

Consultations de
la notice

43

Téléchargements du document

10