Towards scaling up Markov chain Monte Carlo: an adaptive subsampling approach

Abstract : Markov chain Monte Carlo (MCMC) methods are often deemed far too computationally intensive to be of any practical use for large datasets. This paper describes a methodology that aims to scale up the Metropolis-Hastings (MH) algorithm in this context. We propose an approximate implementation of the accept/reject step of MH that only requires evaluating the likelihood of a random subset of the data, yet is guaranteed to coincide with the accept/reject step based on the full dataset with a probability superior to a user-specified tolerance level. This adaptive sub-sampling technique is an alternative to the recent approach developed in (Korattikara et al., 2014), and it allows us to establish rigorously that the resulting approximate MH algorithm samples from a perturbed version of the target distribution of interest, whose total variation distance to this very target is controlled explicitly. We explore the benefits and limitations of this scheme on several examples.
Document type :
Conference papers
Complete list of metadatas

Cited literature [22 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-01254232
Contributor : Rémi Bardenet <>
Submitted on : Monday, January 11, 2016 - 11:36:06 PM
Last modification on : Wednesday, January 13, 2016 - 1:01:58 AM
Long-term archiving on : Tuesday, April 12, 2016 - 11:43:24 AM

File

bardenet14.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01254232, version 1

Collections

Citation

Rémi Bardenet, Arnaud Doucet, Chris Holmes. Towards scaling up Markov chain Monte Carlo: an adaptive subsampling approach. International Conference on Machine Learning (ICML), 2014, Beijing, China. pp.405-413. ⟨hal-01254232⟩

Share

Metrics

Record views

188

Files downloads

215