You are here: MIMS > EPrints
MIMS EPrints

2015.82: Parallel Adaptive Importance Sampling

2015.82: Colin Cotter, Simon Cotter and Paul Russell (2015) Parallel Adaptive Importance Sampling.

Full text available as:

PDF - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
402 Kb

Abstract

Markov chain Monte Carlo methods are a powerful and commonly used family of numerical methods for sampling from complex probability distributions. As applications of these methods increase in size and complexity, the need for efficient methods which can exploit the parallel architectures which are prevalent in high performance computing increases. In this paper, we aim to develop a framework for scalable parallel MCMC algorithms. At each iteration, an importance sampling proposal distribution is formed using the current states of all of the chains within an ensemble. Once weighted samples have been produced from this, a state-of-the-art resampling method is then used to create an evenly weighted sample ready for the next iteration. We demonstrate that this parallel adaptive importance sampling (PAIS) method outperforms naive parallelisation of serial MCMC methods using the same number of processors, for low dimensional problems, and in fact shows better than linear improvements in convergence rates with respect to the number of processors used.

Item Type:MIMS Preprint
Uncontrolled Keywords:MCMC, parallel, importance sampling, Bayesian, inverse problems.
Subjects:MSC 2000 > 62 Statistics
MSC 2000 > 65 Numerical analysis
MIMS number:2015.82
Deposited By:Dr Simon L Cotter
Deposited On:03 September 2015

Download Statistics: last 4 weeks
Repository Staff Only: edit this item