Multiple Bayesian discriminant functions for high-dimensional massive data classification

Abstract : The presence of complex distributions of samples concealed in high-dimensional, massive sample-size data challenges all of the current classification methods for data mining. Samples within a class usually do not uniformly fill a certain (sub)space but are individually concentrated in certain regions of diverse feature subspaces, revealing the class dispersion. Current classifiers applied to such complex data inherently suffer from either high complexity or weak classification ability, due to the imbalance between flexibility and generalization ability of the discriminant functions used by these classifiers. To address this concern, we propose a novel representation of discriminant functions in Bayesian inference, which allows multiple Bayesian decision boundaries per class, each in its individual subspace. For this purpose, we design a learning algorithm that incorporates the naive Bayes and feature weighting approaches into structural risk minimization to learn multiple Bayesian discriminant functions for each class, thus combining the simplicity and effectiveness of naive Bayes and the benefits of feature weighting in handling high-dimensional data. The proposed learning scheme affords a recursive algorithm for exploring class density distribution for Bayesian estimation, and an automated approach for selecting powerful discriminant functions while keeping the complexity of the classifier low. Experimental results on real-world data characterized by millions of samples and features demonstrate the promising performance of our approach.
Type de document :
Article dans une revue
Data Mining and Knowledge Discovery, Springer, 2017, 31 (2), pp.465--501. 〈10.1007/s10618-016-0481-y〉
Liste complète des métadonnées

https://hal.archives-ouvertes.fr/hal-01549570
Contributeur : Patrick Gallinari <>
Soumis le : mercredi 28 juin 2017 - 18:14:13
Dernière modification le : jeudi 29 novembre 2018 - 01:31:08

Identifiants

Collections

Citation

Jianfei Zhang, Shengrui Wang, Lifei Chen, Patrick Gallinari. Multiple Bayesian discriminant functions for high-dimensional massive data classification. Data Mining and Knowledge Discovery, Springer, 2017, 31 (2), pp.465--501. 〈10.1007/s10618-016-0481-y〉. 〈hal-01549570〉

Partager

Métriques

Consultations de la notice

200