Skip to Main content Skip to Navigation
Conference papers

Learning Continuous High-Dimensional Models using Mutual Information and Copula Bayesian Networks

Abstract : We propose a new framework to learn non-parametric graphical models from continuous observational data. Our method is based on concepts from information theory in order to discover independences and causality between variables: the conditional and multivariate mutual information (such as (Verny et al. 2017) for discrete models). To estimate these quantities, we propose non-parametric estimators relying on the Bernstein copula and that are constructed by exploiting the relation between the mutual information and the copula entropy (Ma and Sun 2011; Belalia et al. 2017). To our knowledge, this relation is only documented for the bivariate case and, for the need of our algorithms, is here extended to the conditional and multivariate mutual information. This framework leads to a new algorithm to learn continuous nonparametric Bayesian networks. Moreover, we use this estimator to speed up the BIC algorithm proposed in (Elidan 2010) by taking advantage of the decomposition of the likelihood function in a sum of mutual information (Koller and Friedman 2009). Finally, our method is compared in terms of performances and complexity with other state of the art techniques to learn Copula Bayesian Networks and shows superior results. In particular, it needs less data to recover the original structure and generalizes better on data that are not sampled from Gaussian distributions.
Complete list of metadata

https://hal.archives-ouvertes.fr/hal-03346955
Contributor : Marvin Lasserre Connect in order to contact the contributor
Submitted on : Thursday, September 16, 2021 - 7:17:09 PM
Last modification on : Sunday, June 26, 2022 - 3:13:39 AM
Long-term archiving on: : Friday, December 17, 2021 - 7:33:37 PM

File

aaai2021-paper.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-03346955, version 1

Citation

Marvin Lasserre, Régis Lebrun, Pierre-Henri Wuillemin. Learning Continuous High-Dimensional Models using Mutual Information and Copula Bayesian Networks. The Thirty-Fifth AAAI Conference on Artificial Intelligence, Association for the Advancement of Artificial Intelligence, Feb 2021, Vancouver, Canada. pp.12139-12146. ⟨hal-03346955⟩

Share

Metrics

Record views

35

Files downloads

36