Trustworthy Medical Segmentation with Uncertainty Estimation

by   Giuseppina Carannante, et al.

Deep Learning (DL) holds great promise in reshaping the healthcare systems given its precision, efficiency, and objectivity. However, the brittleness of DL models to noisy and out-of-distribution inputs is ailing their deployment in the clinic. Most systems produce point estimates without further information about model uncertainty or confidence. This paper introduces a new Bayesian deep learning framework for uncertainty quantification in segmentation neural networks, specifically encoder-decoder architectures. The proposed framework uses the first-order Taylor series approximation to propagate and learn the first two moments (mean and covariance) of the distribution of the model parameters given the training data by maximizing the evidence lower bound. The output consists of two maps: the segmented image and the uncertainty map of the segmentation. The uncertainty in the segmentation decisions is captured by the covariance matrix of the predictive distribution. We evaluate the proposed framework on medical image segmentation data from Magnetic Resonances Imaging and Computed Tomography scans. Our experiments on multiple benchmark datasets demonstrate that the proposed framework is more robust to noise and adversarial attacks as compared to state-of-the-art segmentation models. Moreover, the uncertainty map of the proposed framework associates low confidence (or equivalently high uncertainty) to patches in the test input images that are corrupted with noise, artifacts or adversarial attacks. Thus, the model can self-assess its segmentation decisions when it makes an erroneous prediction or misses part of the segmentation structures, e.g., tumor, by presenting higher values in the uncertainty map.


page 1

page 8


Towards Robust General Medical Image Segmentation

The reliability of Deep Learning systems depends on their accuracy but a...

Exploring Structure-Wise Uncertainty for 3D Medical Image Segmentation

When applying a Deep Learning model to medical images, it is crucial to ...

Confidence Calibration and Predictive Uncertainty Estimation for Deep Medical Image Segmentation

Fully convolutional neural networks (FCNs), and in particular U-Nets, ha...

Improving Uncertainty-based Out-of-Distribution Detection for Medical Image Segmentation

Deep Learning models are easily disturbed by variations in the input ima...

Bayesian Neural Networks for Uncertainty Estimation of Imaging Biomarkers

Image segmentation enables to extract quantitative measures from scans t...

Uncertainty Estimation in Deep 2D Echocardiography Segmentation

2D echocardiography is the most common imaging modality for cardiovascul...

Hierarchical Bayesian Operational Modal Analysis: Theory and Computations

This paper presents a hierarchical Bayesian modeling framework for the u...

Please sign up or login with your details

Forgot password? Click here to reset