BCD Nets: Scalable Variational Approaches for Bayesian Causal Discovery

12/06/2021
by   Chris Cundy, et al.
0

A structural equation model (SEM) is an effective framework to reason over causal relationships represented via a directed acyclic graph (DAG). Recent advances have enabled effective maximum-likelihood point estimation of DAGs from observational data. However, a point estimate may not accurately capture the uncertainty in inferring the underlying graph in practical scenarios, wherein the true DAG is non-identifiable and/or the observed dataset is limited. We propose Bayesian Causal Discovery Nets (BCD Nets), a variational inference framework for estimating a distribution over DAGs characterizing a linear-Gaussian SEM. Developing a full Bayesian posterior over DAGs is challenging due to the the discrete and combinatorial nature of graphs. We analyse key design choices for scalable VI over DAGs, such as 1) the parametrization of DAGs via an expressive variational family, 2) a continuous relaxation that enables low-variance stochastic optimization, and 3) suitable priors over the latent variables. We provide a series of experiments on real and synthetic data showing that BCD Nets outperform maximum-likelihood methods on standard causal discovery metrics such as structural Hamming distance in low data regimes.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/03/2022

Interventions, Where and How? Experimental Design for Causal Models at Scale

Causal discovery from observational and interventional data is challengi...
research
01/28/2022

BCDAG: An R package for Bayesian structure and Causal learning of Gaussian DAGs

Directed Acyclic Graphs (DAGs) provide a powerful framework to model cau...
research
07/22/2011

Efficient variational inference in large-scale Bayesian compressed sensing

We study linear models under heavy-tailed priors from a probabilistic vi...
research
08/29/2020

Loss convergence in a causal Bayesian neural network of retail firm performance

We extend the empirical results from the structural equation model (SEM)...
research
03/15/2018

Minimal I-MAP MCMC for Scalable Structure Discovery in Causal DAG Models

Learning a Bayesian network (BN) from data can be useful for decision-ma...
research
05/25/2021

DiBS: Differentiable Bayesian Structure Learning

Bayesian structure learning allows inferring Bayesian network structure ...
research
07/31/2023

A continuous Structural Intervention Distance to compare Causal Graphs

Understanding and adequately assessing the difference between a true and...

Please sign up or login with your details

Forgot password? Click here to reset