Towards scaling up Markov chain Monte Carlo: an adaptive subsampling approach

Abstract : Markov chain Monte Carlo (MCMC) methods are often deemed far too computationally intensive to be of any practical use for large datasets. This paper describes a methodology that aims to scale up the Metropolis-Hastings (MH) algorithm in this context. We propose an approximate implementation of the accept/reject step of MH that only requires evaluating the likelihood of a random subset of the data, yet is guaranteed to coincide with the accept/reject step based on the full dataset with a probability superior to a user-specified tolerance level. This adaptive sub-sampling technique is an alternative to the recent approach developed in (Korattikara et al., 2014), and it allows us to establish rigorously that the resulting approximate MH algorithm samples from a perturbed version of the target distribution of interest, whose total variation distance to this very target is controlled explicitly. We explore the benefits and limitations of this scheme on several examples.
Document type :
Conference papers
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download
Contributor : Rémi Bardenet <>
Submitted on : Monday, January 11, 2016 - 11:36:06 PM
Last modification on : Wednesday, January 13, 2016 - 1:01:58 AM
Long-term archiving on : Tuesday, April 12, 2016 - 11:43:24 AM


Files produced by the author(s)


  • HAL Id : hal-01254232, version 1



Rémi Bardenet, Arnaud Doucet, Chris Holmes. Towards scaling up Markov chain Monte Carlo: an adaptive subsampling approach. International Conference on Machine Learning (ICML), 2014, Beijing, China. pp.405-413. ⟨hal-01254232⟩



Record views


Files downloads