A hybrid algorithm for Bayesian network structure learning with application to multi-label learning

Maxime Gasse 1 Alex Aussem 1 Haytham Elghazel 1
1 DM2L - Data Mining and Machine Learning
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : We present a novel hybrid algorithm for Bayesian network structure learning, called H2PC. It first reconstructs the skeleton of a Bayesian network and then performs a Bayesian-scoring greedy hill-climbing search to orient the edges. The algorithm is based on divide-and-conquer constraint-based subroutines to learn the local structure around a target variable. We conduct two series of experimental comparisons of H2PC against Max–Min Hill-Climbing (MMHC), which is currently the most powerful state-of-the-art algorithm for Bayesian network structure learning. First, we use eight well-known Bayesian network benchmarks with various data sizes to assess the quality of the learned structure returned by the algorithms. Our extensive experiments show that H2PC outperforms MMHC in terms of goodness of fit to new data and quality of the network structure with respect to the true dependence structure of the data. Second, we investigate H2PC’s ability to solve the multi-label learning problem. We provide theoretical results to characterize and identify graphically the so-called minimal label powersets that appear as irreducible factors in the joint distribution under the faithfulness condition. The multi-label learning problem is then decomposed into a series of multi-class classification problems, where each multi-class variable encodes a label powerset. H2PC is shown to compare favorably to MMHC in terms of global classification accuracy over ten multi-label data sets covering different application domains. Overall, our experiments support the conclusions that local structural learning with H2PC in the form of local neighborhood induction is a theoretically well-motivated and empirically effective learning framework that is well suited to multi-label learning. The source code (in R) of H2PC as well as all data sets used for the empirical tests are publicly available.
Complete list of metadatas

Cited literature [74 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01153255
Contributor : Maxime Gasse <>
Submitted on : Tuesday, May 19, 2015 - 2:13:13 PM
Last modification on : Wednesday, November 20, 2019 - 3:18:26 AM
Long-term archiving on: Tuesday, September 15, 2015 - 6:13:15 AM

Files

main.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution - NonCommercial - NoDerivatives 4.0 International License

Identifiers

Citation

Maxime Gasse, Alex Aussem, Haytham Elghazel. A hybrid algorithm for Bayesian network structure learning with application to multi-label learning. Expert Systems with Applications, Elsevier, 2014, 41 (15), pp.6755-6772. ⟨10.1016/j.eswa.2014.04.032⟩. ⟨hal-01153255⟩

Share

Metrics

Record views

1083

Files downloads

345