Skip to Main content Skip to Navigation
Journal articles

Combination of classifiers with optimal weight based on evidential reasoning

Abstract : In pattern classification problem, different classifiers learnt using different training data can provide more or less complementary knowledge, and the combination of classifiers is expected to improve the classification accuracy. Evidential reasoning (ER) provides an efficient framework to represent and combine the imprecise and uncertain information. In this work, we want to focus on the weighted combination of classifiers based on ER. Because each classifier may have different performance on the given data set, the classifiers to combine are considered with different weights. A new weighted classifier combination method is proposed based on ER to enhance the classification accuracy. The optimal weighting factors of classifiers are obtained by minimizing the distances between fusion results obtained by Dempster's rule and the target output in training data space to fully take advantage of the complementarity of the classifiers. A confusion matrix is additionally introduced to characterize the probability of the object belonging to one class but classified to another class by the fusion result. This matrix is also optimized using training data jointly with classifier weight, and it is used to modify the fusion result to make it as close as possible to truth. Moreover, the training patterns are considered with different weights for the parameter optimization in classifier fusion, and the patterns hard to classify are committed with bigger weight than the ones easy to deal with. The pattern weight and the other parameters (i.e. classifier weight and confusion matrix) are iteratively optimized for obtaining the highest classification accuracy. A cautious decision making strategy is introduced to reduce the errors, and the pattern hard to classify will be cautiously committed to a set of classes, because the partial imprecision of decision is considered better than error in certain case. The effectiveness of the proposed method is demonstrated with various real data sets from UCI repository, and its performances are compared with those of other classical methods.
Complete list of metadatas

Cited literature [42 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01588701
Contributor : Arnaud Martin <>
Submitted on : Saturday, September 16, 2017 - 5:13:15 PM
Last modification on : Friday, March 6, 2020 - 4:10:03 PM
Document(s) archivé(s) le : Sunday, December 17, 2017 - 12:34:57 PM

File

FinalVersion.pdf
Files produced by the author(s)

Identifiers

Citation

Zhun-Ga Liu, Quan Pan, Jean Dezert, Arnaud Martin. Combination of classifiers with optimal weight based on evidential reasoning. IEEE Transactions on Fuzzy Systems, Institute of Electrical and Electronics Engineers, 2018, 26 (3), pp.1217_1230. ⟨10.1109/TFUZZ.2017.2718483⟩. ⟨hal-01588701⟩

Share

Metrics

Record views

532

Files downloads

804