Towards Expressive Priors for Bayesian Neural Networks: Poisson Process Radial Basis Function Networks

12/12/2019
by   Beau Coker, et al.
0

While Bayesian neural networks have many appealing characteristics, current priors do not easily allow users to specify basic properties such as expected lengthscale or amplitude variance. In this work, we introduce Poisson Process Radial Basis Function Networks, a novel prior that is able to encode amplitude stationarity and input-dependent lengthscale. We prove that our novel formulation allows for a decoupled specification of these properties, and that the estimated regression function is consistent as the number of observations tends to infinity. We demonstrate its behavior on synthetic and real examples.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset