T. M. Alkhamis, M. A. Ahmed, and V. K. Tuan, Simulated annealing for discrete optimization with estimation, European Journal of Operational Research, vol.116, issue.3, pp.530-544, 1999.
DOI : 10.1016/S0377-2217(98)00112-X

P. Alquier, N. Friel, R. Everitt, and A. Boland, Noisy Monte Carlo: convergence of Markov chains with approximate transition kernels, Statistics and Computing, vol.27, issue.11, 2014.
DOI : 10.1007/s11222-014-9521-x

C. Andrieu and G. O. Roberts, The pseudo-marginal approach for efficient Monte Carlo computations. The Annals of Statistics, pp.697-725, 2009.

C. Andrieu and M. Vihola, Convergence properties of pseudo-marginal Markov chain Monte Carlo algorithms. to appear in Annals of Applied Probability, 2015.

C. Andrieu, A. Doucet, and R. Holenstein, Particle Markov chain Monte Carlo methods, Journal of the Royal Statistical Society: Series B (Statistical Methodology), vol.50, issue.3, 2010.
DOI : 10.1111/j.1467-9868.2009.00736.x

J. Audibert, R. Munos, and C. Szepesvári, Exploration-exploitation trade-off using variance estimates in multi-armed bandits, Theoretical Computer Science, 2009.

M. Banterle, C. Grazan, A. Lee, and C. P. Robert, Accelerating Metropolis-Hastings algorithms by Delayed acceptance, 2015.

R. Bardenet, A. Doucet, and C. Holmes, Towards scaling up MCMC: an adaptive subsampling approach, Proceedings of the International Conference on Machine Learning (ICML), 2014.

M. A. Beaumont, Estimation of population growth or decline in genetically monitored populations, Genetics, vol.164, p.11391160, 2003.

M. J. Betancourt, The Fundamental Incompatibility of Hamiltonian Monte Carlo and Data Subsampling. Preprint, available as http, 2014.

G. Bhanot and A. D. Kennedy, Bosonic lattice gauge theory with noise, Physics Letters B, vol.157, issue.1, pp.70-76, 1985.
DOI : 10.1016/0370-2693(85)91214-6

S. R. Bowling, M. T. Khasawneh, S. Kaewkuekool, and B. R. Cho, A logistic approximation to the cumulative normal distribution, Journal of Industrial Engineering and Management, vol.2, issue.1, pp.114-127, 2009.
DOI : 10.3926/jiem.2009.v2n1.p114-127

J. Branke, S. Meisel, and C. Schmidt, Simulated annealing in the presence of noise, Journal of Heuristics, vol.174, issue.2, pp.627-654, 2008.
DOI : 10.1007/s10732-007-9058-7

A. A. Bulgak and J. L. Sanders, Integrating a modified simulated annealing algorithm with the simulation of a manufacturing system to optimize buffer sizes in automatic assembly systems, Proceedings of the 20th conference on Winter simulation , WSC '88, 1988.
DOI : 10.1145/318123.318302

D. M. Ceperley and M. Dewing, The penalty method for random walks with uncertain energies, The Journal of Chemical Physics, vol.110, issue.20, 1999.
DOI : 10.1063/1.478034

T. Chen, E. B. Fox, and C. Guestrin, Stochastic Gradient Hamiltonian Monte Carlo, Proceedings of the International Conference on Machine Learning (ICML), 2014.

V. Chernozhukov and H. Hong, An MCMC Approach to Classical Estimation, Journal of Econometrics, 2003.

R. Collobert, S. Bengio, and Y. Bengio, A Parallel Mixture of SVMs for Very Large Scale Problems, Neural Computation, vol.20, issue.5, pp.1105-1114, 2002.
DOI : 10.1162/neco.1991.3.1.79

M. Cuturi and A. Doucet, Fast Computation of Wasserstein Barycenters, Proceedings of The International Conference on Machine Learning (ICML), 2014.

R. Douc, ´. E. Moulines, and D. Stoffer, Nonlinear time series, 2014.
URL : https://hal.archives-ouvertes.fr/hal-01263245

A. Doucet, M. Pitt, G. Deligiannidis, and R. Kohn, Efficient implementation of Markov chain Monte Carlo when using an unbiased likelihood estimator, Biometrika, vol.102, issue.2, 2015.
DOI : 10.1093/biomet/asu075

S. Duane, A. D. Kennedy, B. J. Pendleton, and D. Roweth, Hybrid Monte Carlo, Physics Letters B, vol.195, issue.2, pp.2774-2777, 1987.
DOI : 10.1016/0370-2693(87)91197-X

A. Gelman, A. Jakulin, M. G. Pittau, and Y. Su, A weakly informative default prior distribution for logistic and other regression models, The Annals of Applied Statistics, vol.2, issue.4, 2008.
DOI : 10.1214/08-AOAS191

A. Gelman, A. Vehtari, P. Jylänki, C. Robert, N. Chopin et al., Expectation propagation as a way of life, 2014.

P. W. Glynn and C. Rhee, Exact estimation for Markov chain equilibrium expectations, Journal of Applied Probability, vol.22, issue.A, pp.377-389, 2014.
DOI : 10.1145/137926.137932

Z. Huang and A. Gelman, Sampling for Bayesian Computation with Large Datasets, SSRN Electronic Journal, 2005.
DOI : 10.2139/ssrn.1010107

P. E. Jacob and A. H. Thiery, On non-negative unbiased estimators. Preprint, available as http, 2013.

A. Korattikara, Y. Chen, and M. Welling, Austerity in MCMC Land: Cutting the Metropolis-Hastings Budget, Proceedings of the International Conference on Machine Learning (ICML), 2014.

L. Lin, K. F. Liu, and J. Sloan, A noisy Monte Carlo algorithm, Physical Review D, vol.61, issue.7, p.61, 2000.
DOI : 10.1103/PhysRevD.61.074505

D. Maclaurin and R. P. Adams, Firefly Monte Carlo: Exact MCMC with Subsets of Data, Proceedings of the conference on Uncertainty in Artificial Intelligence (UAI), 2014.

C. H. Mak, Stochastic potential switching algorithm for Monte Carlo simulations of complex systems, The Journal of Chemical Physics, vol.122, issue.21, p.122, 2005.
DOI : 10.1063/1.1925273

J. Marin, P. Pudlo, C. P. Robert, and R. Ryder, Approximate Bayesian computational methods, Statistics and Computing, vol.6, issue.31, pp.1167-1180, 2012.
DOI : 10.1007/s11222-011-9288-2

URL : https://hal.archives-ouvertes.fr/hal-00567240

S. Minsker, S. Srivastava, L. Lin, and D. Dunson, Scalable and Robust Bayesian Inference via the Median Posterior, Proceedings of The International Conference on Machine Learning (ICML), 2014.

W. Neiswanger, C. Wang, and E. Xing, Asymptotically exact, embarassingly parallel MCMC, Proceedings of the conference on Uncertainty in Artificial INtelligence (UAI), 2014.

G. K. Nicholls, C. Fox, and A. Muir-watt, Coupled MCMC with a randomized acceptance probability. Preprint, available as http, 2012.

N. S. Pillai and A. Smith, Ergodicity of Approximate MCMC Chains with Applications to Large Data Sets, 2014.

M. Quiroz, M. Villani, and R. Kohn, Speeding Up MCMC by Efficient Data Subsampling. Preprint, available as http, 2014.

C. Rhee and P. W. Glynn, Unbiased Estimation with Square Root Convergence for SDE Models, Operations Research, vol.63, issue.5, 2013.
DOI : 10.1287/opre.2015.1404

C. P. Robert and G. Casella, Monte Carlo Statistical Methods, 2004.

G. O. Roberts and J. S. Rosenthal, Optimal scaling for various Metropolis-Hastings algorithms, Statistical Science, vol.16, issue.4, pp.351-367, 2001.
DOI : 10.1214/ss/1015346320

D. Rudolf and N. Schweizer, Perturbation theory for Markov chains via Wasserstein distance. Preprint, available as http, 2015.

S. L. Scott, A. W. Blocker, &. V. Bonassi, and F. , Bayes and big data: the consensus Monte Carlo algorithm, Proceedings of the Bayes 250 conference, 2013.
DOI : 10.1109/CDC.2012.6426691

S. Singh, M. Wick, and A. Mccallum, Monte Carlo MCMC: Efficient Inference by Approximate Sampling, Proceedings of the Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning, 2012.

S. Srivastava, V. Cevher, Q. Tran-dinh, and D. B. Dunson, WASP: scalable Bayes via barycenters of subset posteriors, 2014.

H. Strathmann, D. Sejdinovic, and M. Girolami, Unbiased Bayes for Big Data: Paths of Partial Posteriors, 2015.

Y. W. Teh, A. H. Thiery, and S. J. Vollmer, Consistency and fluctuations for stochastic gradient Langevin dynamics, 2014.

R. Trotta, Bayes in the sky: Bayesian inference and model selection in cosmology. Contemporary Physics, 2006.

A. W. Van-der-vaart, Asymptotic Statistics, 2000.
DOI : 10.1017/CBO9780511802256

A. W. Van-der-vaart and J. A. Wellner, Weak convergence and empirical processes, 1996.
DOI : 10.1007/978-1-4757-2545-2

L. Wang and L. Zhang, Stochastic optimization using simulated annealing with hypothesis test, Applied Mathematics and Computation, vol.174, issue.2, pp.1329-1342, 2006.
DOI : 10.1016/j.amc.2005.05.038

M. Welling and Y. W. Teh, Bayesian Learning via Stochastic Gradient Langevin Dynamics, Proceedings of the International Conference on Machine Learning (ICML), 2011.

J. Wright, Genetics: Unravelling complexity, Nature, vol.508, issue.7494, pp.6-7, 2014.
DOI : 10.1038/mp.2013.156

M. Xu, B. Lakshminarayanan, Y. W. Teh, J. Zhu, and B. Zhang, Distributed Bayesian posterior sampling via moment sharing, Advances in Neural Information Processing Systems (NIPS), 2014.