Black-box Coreset Variational Inference

by   Dionysis Manousakas, et al.

Recent advances in coreset methods have shown that a selection of representative datapoints can replace massive volumes of data for Bayesian inference, preserving the relevant statistical information and significantly accelerating subsequent downstream tasks. Existing variational coreset constructions rely on either selecting subsets of the observed datapoints, or jointly performing approximate inference and optimizing pseudodata in the observed space akin to inducing points methods in Gaussian Processes. So far, both approaches are limited by complexities in evaluating their objectives for general purpose models, and require generating samples from a typically intractable posterior over the coreset throughout inference and testing. In this work, we present a black-box variational inference framework for coresets that overcomes these constraints and enables principled application of variational coresets to intractable models, such as Bayesian neural networks. We apply our techniques to supervised learning problems, and compare them with existing approaches in the literature for data summarization and inference.


page 21

page 22

page 23

page 24

page 26


Efficient Approximate Inference with Walsh-Hadamard Variational Inference

Variational inference offers scalable and flexible tools to tackle intra...

Operator Variational Inference

Variational inference is an umbrella term for algorithms which cast Baye...

β-Cores: Robust Large-Scale Bayesian Data Summarization in the Presence of Outliers

Modern machine learning applications should be able to address the intri...

Bayesian inference of ODEs with Gaussian processes

Recent machine learning advances have proposed black-box estimation of u...

Vprop: Variational Inference using RMSprop

Many computationally-efficient methods for Bayesian deep learning rely o...

Analytically Tractable Hidden-States Inference in Bayesian Neural Networks

With few exceptions, neural networks have been relying on backpropagatio...

Variational State-Space Models for Localisation and Dense 3D Mapping in 6 DoF

We solve the problem of 6-DoF localisation and 3D dense reconstruction i...

Please sign up or login with your details

Forgot password? Click here to reset