Thermostat-assisted Continuous-tempered Hamiltonian Monte Carlo for Multimodal Posterior Sampling

11/30/2017
by   Rui Luo, et al.
0

In this paper, we propose a new sampling method named as the thermostat-assisted continuous-tempered Hamiltonian Monte Carlo for multimodal posterior sampling on large datasets. It simulates a noisy system, which is augmented by a coupling tempering variable as well as a set of Nosé-Hoover thermostats. This augmentation is devised to address two main issues of concern: the first is to effectively generate i.i.d. samples from complex multimodal posterior distributions; the second is to adaptively control the system dynamics in the presence of unknown noise that arises from the use of mini-batches. The experiment on synthetic distributions has been performed; the result demonstrates the effectiveness of the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/04/2018

Parallel-tempered Stochastic Gradient Hamiltonian Monte Carlo for Approximate Multimodal Posterior Sampling

We propose a new sampler that integrates the protocol of parallel temper...
research
06/05/2017

Stochastic Gradient Monomial Gamma Sampler

Recent advances in stochastic gradient techniques have made it possible ...
research
05/29/2019

Replica-exchange Nosé-Hoover dynamics for Bayesian learning on large datasets

In this paper, we propose a new sampler for Bayesian learning that can e...
research
10/11/2018

Stochastic Approximation Hamiltonian Monte Carlo

Recently, the Hamilton Monte Carlo (HMC) has become widespread as one of...
research
04/19/2020

Zig-zag sampling for discrete structures and non-reversible phylogenetic MCMC

We construct a zig-zag process targeting posterior distributions arising...
research
03/20/2019

TATi-Thermodynamic Analytics ToolkIt: TensorFlow-based software for posterior sampling in machine learning applications

We describe a TensorFlow-based library for posterior sampling and explor...
research
11/14/2017

Neural Network Gradient Hamiltonian Monte Carlo

Hamiltonian Monte Carlo is a widely used algorithm for sampling from pos...

Please sign up or login with your details

Forgot password? Click here to reset