A Point Mass Proposal Method for Bayesian State-Space Model Fitting
State-space models (SSMs) are often used to model time series data where the observations depend on an unobserved latent process. However, inference on the process parameters of an SSM can be challenging, especially when the likelihood of the data given the parameters is not available in closed form. We focus on the problem of model fitting within a Bayesian framework, to which a variety of approaches have been applied, including MCMC using Bayesian data augmentation, sequential Monte Carlo (SMC) approximation, and particle MCMC algorithms, which combine SMC approximations and MCMC steps. However, these different methods can be inefficient because of sample impoverishment in the sequential Monte Carlo approximations and/or poor mixing in the MCMC steps. In this article, we propose an approach that borrows ideas from discrete hidden Markov models (HMMs) to provide an efficient MCMC with data augmentation approach, imputing the latent states within the algorithm. Our approach deterministically approximates the SSM by a discrete HMM, which is subsequently used as an MCMC proposal distribution for the latent states. We demonstrate that the algorithm provides an efficient alternative approach via two different case studies.
READ FULL TEXT