An Experimental Comparison of Hybrid Algorithms for Bayesian Network Structure Learning

Maxime Gasse 1 Alex Aussem 1 Haytham Elghazel 1
1 DM2L - Data Mining and Machine Learning
LIRIS - Laboratoire d'InfoRmatique en Image et Systèmes d'information
Abstract : We present a novel hybrid algorithm for Bayesian network structure learning, called Hybrid HPC (H2PC). It first reconstructs the skeleton of a Bayesian network and then performs a Bayesian-scoring greedy hill-climbing search to orient the edges. It is based on a subroutine called HPC, that combines ideas from incremental and divide-and-conquer constraint-based methods to learn the parents and children of a target variable. We conduct an experimental comparison of H2PC against Max-Min Hill-Climbing (MMHC), which is currently the most powerful state-of-the-art algorithm for Bayesian network structure learning, on several benchmarks with various data sizes. Our extensive experiments show that H2PC outperforms MMHC both in terms of goodness of fit to new data and in terms of the quality of the network structure itself, which is closer to the true dependence structure of the data. The source code (in R) of H2PC as well as all data sets used for the empirical tests are publicly available.
Keywords : bayesian network
Complete list of metadatas

Cited literature [35 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01122771
Contributor : Maxime Gasse <>
Submitted on : Monday, May 18, 2015 - 3:15:11 PM
Last modification on : Wednesday, November 20, 2019 - 2:39:45 AM
Long-term archiving on : Tuesday, September 15, 2015 - 1:40:37 AM

Files

main.pdf
Files produced by the author(s)

Licence


Distributed under a Creative Commons Attribution - ShareAlike 4.0 International License

Identifiers

Citation

Maxime Gasse, Alex Aussem, Haytham Elghazel. An Experimental Comparison of Hybrid Algorithms for Bayesian Network Structure Learning. Lecture Notes in Computer Science, Springer, 2012, Machine Learning and Knowledge Discovery in Databases, 7523, pp.58-73. ⟨10.1007/978-3-642-33460-3_9⟩. ⟨hal-01122771⟩

Share

Metrics

Record views

1071

Files downloads

334