A Modularized Efficient Framework for Non-Markov Time Series Estimation

by   Gabriel Schamberg, et al.

We present a compartmentalized approach to finding the maximum a-posteriori (MAP) estimate of a latent time series that obeys a dynamic stochastic model and is observed through noisy measurements. We specifically consider modern signal processing problems with non-Markov signal dynamics (e.g. group sparsity) and/or non-Gaussian measurement models (e.g. point process observation models used in neuroscience). Through the use of auxiliary variables in the MAP estimation problem, we show that a consensus formulation of the alternating direction method of multipliers (ADMM) enables iteratively computing separate estimates based on the likelihood and prior and subsequently "averaging" them in an appropriate sense using a Kalman smoother. As such, this can be applied to a broad class of problem settings and only requires modular adjustments when interchanging various aspects of the statistical model. Under broad log-concavity assumptions, we show that the separate estimation problems are convex optimization problems and that the iterative algorithm converges to the MAP estimate. As such, this framework can capture non-Markov latent time series models and non-Gaussian measurement models. We provide example applications involving (i) group-sparsity priors, within the context of electrophysiologic specrotemporal estimation, and (ii) non-Gaussian measurement models, within the context of dynamic analyses of learning with neural spiking and behavioral observations.


An Efficient ADMM Algorithm for Structural Break Detection in Multivariate Time Series

We present an efficient alternating direction method of multipliers (ADM...

Sparse-Group Log-Sum Penalized Graphical Model Learning For Time Series

We consider the problem of inferring the conditional independence graph ...

Maximum a Posteriori Estimation in Graphical Models Using Local Linear Approximation

Sparse structure learning in high-dimensional Gaussian graphical models ...

Recursive Variational Bayesian Dual Estimation for Nonlinear Dynamics and Non-Gaussian Observations

State space models provide an interpretable framework for complex time s...

Sparse/Robust Estimation and Kalman Smoothing with Nonsmooth Log-Concave Densities: Modeling, Computation, and Theory

We introduce a class of quadratic support (QS) functions, many of which ...

Using flexible noise models to avoid noise model misspecification in inference of differential equation time series models

When modelling time series, it is common to decompose observed variation...

Multitaper Spectral Analysis of Neuronal Spiking Activity Driven by Latent Stationary Processes

Investigating the spectral properties of the neural covariates that unde...

Please sign up or login with your details

Forgot password? Click here to reset