Boosted Training of Convolutional Neural Networks for Multi-Class Segmentation

06/13/2018
by   Lorenz Berger, et al.
0

Training deep neural networks on large and sparse datasets is still challenging and can require large amounts of computation and memory. In this work, we address the task of performing semantic segmentation on large volumetric data sets, such as CT scans. Our contribution is threefold: 1) We propose a boosted sampling scheme that uses a-posterior error maps, generated throughout train- ing, to focus sampling on difficult regions, resulting in a more informative loss. This results in a significant training speed up and improves learning performance for image segmentation. 2) We propose a novel algorithm for boosting the SGD learning rate schedule by adaptively increasing and lowering the learning rate, avoiding the need for extensive hyperparameter tuning. 3) We show that our method is able to attain new state-of-the-art results on the VISCERAL Anatomy benchmark.

READ FULL TEXT
research
09/08/2017

An Adaptive Sampling Scheme to Efficiently Train Fully Convolutional Networks for Semantic Segmentation

Deep convolutional neural networks (CNNs) have shown excellent performan...
research
05/30/2021

LRTuner: A Learning Rate Tuner for Deep Neural Networks

One very important hyperparameter for training deep neural networks is t...
research
04/05/2023

NUMSnet: Nested-U Multi-class Segmentation network for 3D Medical Image Stacks

Semantic segmentation for medical 3D image stacks enables accurate volum...
research
11/30/2021

AutoDrop: Training Deep Learning Models with Automatic Learning Rate Drop

Modern deep learning (DL) architectures are trained using variants of th...
research
01/18/2018

On the influence of Dice loss function in multi-class organ segmentation of abdominal CT using 3D fully convolutional networks

Deep learning-based methods achieved impressive results for the segmenta...
research
12/14/2020

Improving Panoptic Segmentation at All Scales

Crop-based training strategies decouple training resolution from GPU mem...
research
01/10/2023

Explaining Deep Models through Forgettable Learning Dynamics

Even though deep neural networks have shown tremendous success in countl...

Please sign up or login with your details

Forgot password? Click here to reset