TY - JOUR
T1 - Combination of Classifiers With Optimal Weight Based on Evidential Reasoning
AU - Liu, Zhun Ga
AU - Pan, Quan
AU - Dezert, Jean
AU - Martin, Arnaud
N1 - Publisher Copyright:
© 1993-2012 IEEE.
PY - 2018/6
Y1 - 2018/6
N2 - In pattern classification problem, different classifiers learnt using different training data can provide more or less complementary knowledge, and the combination of classifiers is expected to improve the classification accuracy. Evidential reasoning (ER) provides an efficient framework to represent and combine the imprecise and uncertain informations. In this paper, we want to focus on the weighted combination of classifiers based on ER. Because each classifier may have different performance on the given dataset, the classifiers to combine are considered with different weights. A new weighted classifier combination method is proposed based on ER to enhance the classification accuracy. The optimal weighting factors of classifiers are obtained by minimizing the distances between fusion results obtained by Dempster's rule and the target output in training data space to fully take advantage of the complementarity of the classifiers. A confusion matrix is additionally introduced to characterize the probability of the object belonging to one class but classified to another class by the fusion result. This matrix is also optimized using training data jointly with classifier weight, and it is used to modify the fusion result to make it as close as possible to truth. Moreover, the training patterns are considered with different weights for the parameter optimization in classifier fusion, and the patterns hard to classify are committed with bigger weight than the ones easy to deal with. The pattern weight and the other parameters (i.e., classifier weight and confusion matrix) are iteratively optimized for obtaining the highest classification accuracy. A cautious decision making strategy is introduced to reduce the errors, and the pattern hard to classify will be cautiously committed to a set of classes, because the partial imprecision of decision is considered better than error in certain case. The effectiveness of the proposed method is demonstrated with various real datasets from UCI repository, and its performances are compared with those of other classical methods.
AB - In pattern classification problem, different classifiers learnt using different training data can provide more or less complementary knowledge, and the combination of classifiers is expected to improve the classification accuracy. Evidential reasoning (ER) provides an efficient framework to represent and combine the imprecise and uncertain informations. In this paper, we want to focus on the weighted combination of classifiers based on ER. Because each classifier may have different performance on the given dataset, the classifiers to combine are considered with different weights. A new weighted classifier combination method is proposed based on ER to enhance the classification accuracy. The optimal weighting factors of classifiers are obtained by minimizing the distances between fusion results obtained by Dempster's rule and the target output in training data space to fully take advantage of the complementarity of the classifiers. A confusion matrix is additionally introduced to characterize the probability of the object belonging to one class but classified to another class by the fusion result. This matrix is also optimized using training data jointly with classifier weight, and it is used to modify the fusion result to make it as close as possible to truth. Moreover, the training patterns are considered with different weights for the parameter optimization in classifier fusion, and the patterns hard to classify are committed with bigger weight than the ones easy to deal with. The pattern weight and the other parameters (i.e., classifier weight and confusion matrix) are iteratively optimized for obtaining the highest classification accuracy. A cautious decision making strategy is introduced to reduce the errors, and the pattern hard to classify will be cautiously committed to a set of classes, because the partial imprecision of decision is considered better than error in certain case. The effectiveness of the proposed method is demonstrated with various real datasets from UCI repository, and its performances are compared with those of other classical methods.
KW - Belief functions
KW - classifier fusion
KW - combination rule
KW - Dempster-Shafer theory (DST)
KW - evidential reasoning (ER)
UR - http://www.scopus.com/inward/record.url?scp=85021795025&partnerID=8YFLogxK
U2 - 10.1109/TFUZZ.2017.2718483
DO - 10.1109/TFUZZ.2017.2718483
M3 - 文章
AN - SCOPUS:85021795025
SN - 1063-6706
VL - 26
SP - 1217
EP - 1230
JO - IEEE Transactions on Fuzzy Systems
JF - IEEE Transactions on Fuzzy Systems
IS - 3
ER -