1508 articles – 1625 references  [version française]
HAL: hal-00536044, version 1

Detailed view  Export this paper
Measuring information flow in networks of stochastic processes
Pierre-Olivier Amblard 1, Olivier J.J. Michel 1
(2009-11-27)

This paper deals with the study of interacting systems networks. More precisely, we consider the problem of inferring the circulation of information between network nodes. To take into account feedback between signals, as well as instantaneous interaction, we show that the adequate measures of information flow are the directed information and the causal conditional directed information. We relate the framework based on directed information theory to the theory of Granger causality in multivariate time series. An important result of the paper is the proof that linear implementation of Granger causality and directed information theory are equivalent in the Gaussian case. This is proved for the bivariate analysis as well as for the multivariate analysis, for which we extend some of Geweke's results. The relations between directed information and transfer entropy are provided. A simulation illustrates the main results obtained in the paper through the problem of inferring effective connectivity in a network.
1:  Grenoble Images Parole Signal Automatique (GIPSA-lab)
CNRS : UMR5216 – Université Joseph Fourier - Grenoble I – Université Pierre-Mendès-France - Grenoble II – Université Stendhal - Grenoble III – Institut Polytechnique de Grenoble - Grenoble Institute of Technology
C2S
Mathematics/Information Theory

Computer Science/Information Theory and Coding
Fulltext link: 
http://fr.arXiv.org/abs/0911.2873