Streaming Variational Monte Carlo

by   Yuan Zhao, et al.
Stony Brook University

Nonlinear state-space models are powerful tools to describe dynamical structures in complex time series. In a streaming setting where data are processed one sample at a time, simultaneously inferring the state and their nonlinear dynamics has posed significant challenges in practice. We develop a novel online learning framework, leveraging variational inference and sequential Monte Carlo, which enables flexible and accurate Bayesian joint filtering. Our method provides a filtering posterior arbitrarily close to the true filtering distribution for a wide class of dynamics models and observation models. Specifically, the proposed framework can efficiently infer a posterior over the dynamics using sparse Gaussian processes. Constant time complexity per sample makes our approach amenable to online learning scenarios and suitable for real-time applications.


page 1

page 2

page 3

page 4

page 6

page 7

page 8

page 10


Recursive Variational Bayesian Dual Estimation for Nonlinear Dynamics and Non-Gaussian Observations

State space models provide an interpretable framework for complex time s...

Bayesian Inference and Learning in Gaussian Process State-Space Models with Particle MCMC

State-space models are successfully used in many areas of science, engin...

Exact Kalman Filter for Binary Time Series

Non-Gaussian state-space models arise routinely in several applications....

A Learning-to-Infer Method for Real-Time Power Grid Topology Identification

Identifying arbitrary topologies of power networks in real time is a com...

Online Approximate Bayesian learning

We introduce in this work a new method for online approximate Bayesian l...

A Variational Bayesian State-Space Approach to Online Passive-Aggressive Regression

Online Passive-Aggressive (PA) learning is a class of online margin-base...

Please sign up or login with your details

Forgot password? Click here to reset