Simple and Accurate Uncertainty Quantification from Bias-Variance Decomposition

02/13/2020
by   Shi Hu, et al.
43

Accurate uncertainty quantification is crucial for many applications where decisions are in play. Examples include medical diagnosis and self-driving vehicles. We propose a new method that is based directly on the bias-variance decomposition, where the parameter uncertainty is given by the variance of an ensemble divided by the number of members in the ensemble, and the aleatoric uncertainty plus the squared bias is estimated by training a separate model that is regressed directly on the errors of the predictor. We demonstrate that this simple sequential procedure provides much more accurate uncertainty estimates than the current state-of-the-art on two MRI reconstruction tasks.

READ FULL TEXT
research
03/01/2021

Uncertainty Quantification by Ensemble Learning for Computational Optical Form Measurements

Uncertainty quantification by ensemble learning is explored in terms of ...
research
10/21/2022

Uncertainty Estimates of Predictions via a General Bias-Variance Decomposition

Reliably estimating the uncertainty of a prediction throughout the model...
research
03/15/2019

Crowd Counting with Decomposed Uncertainty

Research in neural networks in the field of computer vision has achieved...
research
11/11/2019

Accurate Uncertainty Estimation and Decomposition in Ensemble Learning

Ensemble learning is a standard approach to building machine learning sy...
research
12/01/2018

Quantifying the uncertainty of variance partitioning estimates of ecological datasets

An important objective of experimental biology is the quantification of ...
research
11/25/2020

Bayesian Triplet Loss: Uncertainty Quantification in Image Retrieval

Uncertainty quantification in image retrieval is crucial for downstream ...
research
10/16/2017

Contributed Discussion to Uncertainty Quantification for the Horseshoe by Stéphanie van der Pas, Botond Szabó and Aad van der Vaart

We begin by introducing the main ideas of the paper under discussion. We...

Please sign up or login with your details

Forgot password? Click here to reset