The two-way cooperative information bottleneck

Vera Matias (1) , Leonardo Rey Vega (1) , Pablo Piantanida (2)

1 CONICET - Consejo Nacional de Investigaciones Científicas y Técnicas [Buenos Aires]
2 L2S - Laboratoire des signaux et systèmes

The two-way Information Bottleneck problem, where two nodes exchange information iteratively about two arbitrarily dependent memoryless sources, is considered. Based on the observations and the information exchange, each node is required to extract “relevant information”, measured in terms of the normalized mutual information, from two arbitrarily dependent hidden sources. The optimal trade-off between rates of relevance and complexity, and the number of exchange rounds, is obtained through a single-letter characterization. We further extend the results to the Gaussian case. Applications of our setup arise in the development of collaborative clustering algorithms.

Domaines: Théorie de l'information [cs.IT]; Réseaux et télécommunications [cs.NI]; Théorie de l'information et codage [math.IT]; Statistiques [math.ST]

Vera Matias, Leonardo Rey Vega, Pablo Piantanida. The two-way cooperative information bottleneck. IEEE International Symposium on Information Theory - (ISIT 2015), Jun 2015, Hong Kong, Hong Kong SAR China. ⟨10.1109/ISIT.2015.7282832⟩. ⟨hal-01257614⟩