Deep Sub-Ensembles for Fast Uncertainty Estimation in Image Classification

10/17/2019
by   Matias Valdenegro-Toro, et al.
0

Fast estimates of model uncertainty are required for many robust robotics applications. Deep Ensembles provides state of the art uncertainty without requiring Bayesian methods, but still it is computationally expensive. In this paper we propose deep sub-ensembles, an approximation to deep ensembles where the core idea is to ensemble only the layers close to the output. Our results show that this idea enables a trade-off between error and uncertainty quality versus computational performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/15/2020

Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learning

Uncertainty estimation and ensembling methods go hand-in-hand. Uncertain...
research
10/10/2022

Layer Ensembles

Deep Ensembles, as a type of Bayesian Neural Networks, can be used to es...
research
09/20/2023

You can have your ensemble and run it too – Deep Ensembles Spread Over Time

Ensembles of independently trained deep neural networks yield uncertaint...
research
03/14/2023

Window-Based Early-Exit Cascades for Uncertainty Estimation: When Deep Ensembles are More Efficient than Single Models

Deep Ensembles are a simple, reliable, and effective method of improving...
research
05/27/2021

Deep Ensembles from a Bayesian Perspective

Deep ensembles can be seen as the current state-of-the-art for uncertain...
research
10/05/2020

Multi-Loss Sub-Ensembles for Accurate Classification with Uncertainty Estimation

Deep neural networks (DNNs) have made a revolution in numerous fields du...
research
03/03/2022

Ensembles of Vision Transformers as a New Paradigm for Automated Classification in Ecology

Monitoring biodiversity is paramount to manage and protect natural resou...

Please sign up or login with your details

Forgot password? Click here to reset