Self-Supervised Learning as a Means To Reduce the Need for Labeled Data in Medical Image Analysis

06/01/2022
by   Marin Benčević, et al.
0

One of the largest problems in medical image processing is the lack of annotated data. Labeling medical images often requires highly trained experts and can be a time-consuming process. In this paper, we evaluate a method of reducing the need for labeled data in medical image object detection by using self-supervised neural network pretraining. We use a dataset of chest X-ray images with bounding box labels for 13 different classes of anomalies. The networks are pretrained on a percentage of the dataset without labels and then fine-tuned on the rest of the dataset. We show that it is possible to achieve similar performance to a fully supervised model in terms of mean average precision and accuracy with only 60% of the labeled data. We also show that it is possible to increase the maximum performance of a fully-supervised model by adding a self-supervised pretraining step, and this effect can be observed with even a small amount of unlabeled data for pretraining.

READ FULL TEXT
research
01/13/2021

Big Self-Supervised Models Advance Medical Image Classification

Self-supervised pretraining followed by supervised fine-tuning has seen ...
research
04/11/2023

Self-supervision for medical image classification: state-of-the-art performance with  100 labeled training samples per class

Is self-supervised deep learning (DL) for medical image analysis already...
research
12/22/2021

Community Detection in Medical Image Datasets: Using Wavelets and Spectral Methods

Medical image datasets can have large number of images representing pati...
research
07/06/2023

Encoder-Decoder Networks for Self-Supervised Pretraining and Downstream Signal Bandwidth Regression on Digital Antenna Arrays

This work presents the first applications of self-supervised learning ap...
research
05/13/2023

How to Train Your CheXDragon: Training Chest X-Ray Models for Transfer to Novel Tasks and Healthcare Systems

Self-supervised learning (SSL) enables label efficient training for mach...
research
09/18/2023

Self-supervised TransUNet for Ultrasound regional segmentation of the distal radius in children

Supervised deep learning offers great promise to automate analysis of me...
research
09/16/2020

Evaluating Self-Supervised Pretraining Without Using Labels

A common practice in unsupervised representation learning is to use labe...

Please sign up or login with your details

Forgot password? Click here to reset