Random Function Priors for Correlation Modeling

05/09/2019
by   Aonan Zhang, et al.
0

The likelihood model of many high dimensional data X_n can be expressed as p(X_n|Z_n,θ), where θ:=(θ_k)_k∈[K] is a collection of hidden features shared across objects (indexed by n). And Z_n is a non-negative factor loading vector with K entries where Z_nk indicates the strength of θ_k used to express X_n. In this paper, we introduce random function priors for Z_n that capture rich correlations among its entries Z_n1 through Z_nK. In particular, our model can be treated as a generalized paintbox model Broderick13 using random functions, which can be learned efficiently via amortized variational inference. We derive our model by applying a representation theorem on separately exchangeable discrete random measures.

READ FULL TEXT
research
03/27/2022

Random Graphs by Product Random Measures

A natural representation of random graphs is the random measure. The col...
research
02/04/2021

Sharper Sub-Weibull Concentrations: Non-asymptotic Bai-Yin Theorem

Arising in high-dimensional probability, non-asymptotic concentration in...
research
10/05/2021

Random matrices in service of ML footprint: ternary random features with no performance loss

In this article, we investigate the spectral behavior of random features...
research
08/02/2023

Simulation-based inference using surjective sequential neural likelihood estimation

We present Surjective Sequential Neural Likelihood (SSNL) estimation, a ...
research
11/18/2020

Matrix compatibility and correlation mixture representation of generalized Gini's gamma

Representations of measures of concordance in terms of Pearson's correla...
research
12/23/2019

Sparse Polynomial Chaos expansions using Variational Relevance Vector Machines

The challenges for non-intrusive methods for Polynomial Chaos modeling l...

Please sign up or login with your details

Forgot password? Click here to reset