Dissimilarity Metric Learning in the Belief Function Framework

Chunfeng Lian (1, 2) , Su Ruan (2) , Thierry Denoeux (3, 1)

1 Heudiasyc - Heuristique et Diagnostic des Systèmes Complexes [Compiègne]
2 QuantIF-LITIS - Equipe Quantification en Imagerie Fonctionnelle
3 Labex MS2T - Laboratoire d'Excellence "Maîtrise des Systèmes de Systèmes Technologiques"

The Evidential K-Nearest-Neighbor (EK-NN) method provided a global treatment of imperfect knowledge regarding the class membership of training patterns. It has outperformed traditional K-NN rules in many applications, but still shares some of their basic limitations, e.g., 1) classification accuracy depends heavily on how to quantify the dissimilarity between different patterns and 2) no guarantee for satisfactory performance when training patterns contain unreliable (imprecise and/or uncertain) input features. In this paper, we propose to address these issues by learning a suitable metric, using a low-dimensional transformation of the input space, so as to maximize both the accuracy and efficiency of the EK-NN classification. To this end, a novel loss function to learn the dissimilarity metric is constructed. It consists of two terms: the first one quantifies the imprecision regarding the class membership of each training pattern; while, by means of feature selection, the second one controls the influence of unreliable input features on the output linear transformation. The proposed method has been compared with some other metric learning methods on several synthetic and real data sets. It consistently led to comparable performance with regard to testing accuracy and class structure visualization.

Mots clés: Evidential K-NN; Dissimilarity Metric Learning; Index Terms—Dempster-Shafer Theory; Feature Selection; Feature Transformation; Pattern Classification; Dimensionality Reduction

Domaines: Intelligence artificielle [cs.AI]

Chunfeng Lian, Su Ruan, Thierry Denoeux. Dissimilarity Metric Learning in the Belief Function Framework. IEEE Transactions on Fuzzy Systems, 2016, 24 (6), pp.1555-1564. ⟨10.1109/TFUZZ.2016.2540068⟩. ⟨hal-01294272⟩