Bayesian Inference using the Proximal Mapping: Uncertainty Quantification under Varying Dimensionality

by   Maoran Xu, et al.

In statistical applications, it is common to encounter parameters supported on a varying or unknown dimensional space. Examples include the fused lasso regression, the matrix recovery under an unknown low rank, etc. Despite the ease of obtaining a point estimate via the optimization, it is much more challenging to quantify their uncertainty – in the Bayesian framework, a major difficulty is that if assigning the prior associated with a p-dimensional measure, then there is zero posterior probability on any lower-dimensional subset with dimension d<p; to avoid this caveat, one needs to choose another dimension-selection prior on d, which often involves a highly combinatorial problem. To significantly reduce the modeling burden, we propose a new generative process for the prior: starting from a continuous random variable such as multivariate Gaussian, we transform it into a varying-dimensional space using the proximal mapping. This leads to a large class of new Bayesian models that can directly exploit the popular frequentist regularizations and their algorithms, such as the nuclear norm penalty and the alternating direction method of multipliers, while providing a principled and probabilistic uncertainty estimation. We show that this framework is well justified in the geometric measure theory, and enjoys a convenient posterior computation via the standard Hamiltonian Monte Carlo. We demonstrate its use in the analysis of the dynamic flow network data.


page 1

page 2

page 3

page 4


l_1-ball Prior: Uncertainty Quantification with Exact Zeros

Lasso and l_1-regularization play a dominating role in high dimensional ...

Bayesian Uncertainty Quantification for Low-rank Matrix Completion

We consider the problem of uncertainty quantification for an unknown low...

LR-GLM: High-Dimensional Bayesian Inference Using Low-Rank Data Approximations

Due to the ease of modern data collection, applied statisticians often h...

Bayesian Poroelastic Aquifer Characterization from InSAR Surface Deformation Data Part II: Quantifying the Uncertainty

Uncertainty quantification of groundwater (GW) aquifer parameters is cri...

Uncertainty Quantification in Bayesian Reduced-Rank Sparse Regressions

Reduced-rank regression recognises the possibility of a rank-deficient m...

T-LoHo: A Bayesian Regularization Model for Structured Sparsity and Smoothness on Graphs

Many modern complex data can be represented as a graph. In models dealin...

Bayesian Multi-scale Modeling of Factor Matrix without using Partition Tree

The multi-scale factor models are particularly appealing for analyzing m...

Please sign up or login with your details

Forgot password? Click here to reset