A. Nedic and A. Ozdaglar, Distributed Subgradient Methods for Multi-Agent Optimization, IEEE Transactions on Automatic Control, vol.54, issue.1, pp.48-61, 2009.
DOI : 10.1109/TAC.2008.2009515

A. Nedi´cnedi´c, Asynchronous broadcast-based convex optimization over a network Automatic Control, IEEE Transactions on, vol.56, issue.6, pp.1337-1351, 2011.

A. Agarwal, J. Martin, . Wainwright, C. John, and . Duchi, Distributed dual averaging in networks, Advances in Neural Information Processing Systems, pp.550-558, 2010.

I. Colin, A. Bellet, J. Salmon, and S. Clémençon, Gossip dual averaging for decentralized optimization of pairwise functions, Proc. ICML, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01329315

C. Dupuy and F. Bach, Online but accurate inference for latent variable models with local gibbs sampling. arXiv preprint, 2016.
URL : https://hal.archives-ouvertes.fr/hal-01284900

O. Cappé and E. Moulines, On-line expectation-maximization algorithm for latent data models, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.11, issue.3, pp.593-613, 2009.
DOI : 10.1111/j.1467-9868.2009.00698.x

M. D. Hoffman, D. M. Blei, and F. R. Bach, Online learning for latent Dirichlet allocation, Adv. NIPS, 2010.

T. L. Griffiths and M. Steyvers, Finding scientific topics, Proceedings of the National Academy of Sciences, pp.5228-5235, 2004.
DOI : 10.1073/pnas.0307752101

I. Sato, K. Kurihara, and H. Nakagawa, Deterministic single-pass algorithm for LDA, Adv. NIPS, 2010.

D. Mimno, M. Hoffman, and D. Blei, Sparse stochastic inference for latent Dirichlet allocation, Proc. ICML, 2012.

E. L. Lehmann and G. Casella, Theory of point estimation, 1998.

A. P. Dempster, N. M. Laird, and D. B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, Journal of the royal statistical society. Series B (methodological), vol.39, issue.1, pp.1-38, 1977.

S. Boyd, A. Ghosh, B. Prabhakar, and D. Shah, Randomized gossip algorithms, IEEE Transactions on Information Theory, vol.52, issue.6, pp.2508-2530, 2006.
DOI : 10.1109/TIT.2006.874516

J. Duncan, . Watts, H. Steven, and . Strogatz, Collective dynamics of 'small-world'networks, Nature, vol.393, issue.6684, pp.440-442, 1998.

S. Patterson and Y. W. Teh, Stochastic gradient Riemannian langevin dynamics on the probability simplex, Adv. NIPS, 2013.

Y. Gao, J. Chen, and J. Zhu, Streaming gibbs sampling for LDA model, 2016.

H. M. Wallach, I. Murray, R. Salakhutdinov, and D. Mimno, Evaluation methods for topic models, Proceedings of the 26th Annual International Conference on Machine Learning, ICML '09, 2009.
DOI : 10.1145/1553374.1553515