Towards Automated Polyp Segmentation Using Weakly- and Semi-Supervised Learning and Deformable Transformers

by   Guangyu Ren, et al.

Polyp segmentation is a crucial step towards computer-aided diagnosis of colorectal cancer. However, most of the polyp segmentation methods require pixel-wise annotated datasets. Annotated datasets are tedious and time-consuming to produce, especially for physicians who must dedicate their time to their patients. We tackle this issue by proposing a novel framework that can be trained using only weakly annotated images along with exploiting unlabeled images. To this end, we propose three ideas to address this problem, more specifically our contributions are: 1) a novel sparse foreground loss that suppresses false positives and improves weakly-supervised training, 2) a batch-wise weighted consistency loss utilizing predicted segmentation maps from identical networks trained using different initialization during semi-supervised training, 3) a deformable transformer encoder neck for feature enhancement by fusing information across levels and flexible spatial locations. Extensive experimental results demonstrate the merits of our ideas on five challenging datasets outperforming some state-of-the-art fully supervised models. Also, our framework can be utilized to fine-tune models trained on natural image segmentation datasets drastically improving their performance for polyp segmentation and impressively demonstrating superior performance to fully supervised fine-tuning.


page 1

page 2

page 14

page 15

page 16

page 17


Weakly Supervised Deep Nuclei Segmentation Using Partial Points Annotation in Histopathology Images

Nuclei segmentation is a fundamental task in histopathology image analys...

Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation

Deep convolutional neural networks (DCNNs) trained on a large number of ...

DIAS: A Comprehensive Benchmark for DSA-sequence Intracranial Artery Segmentation

Automatic segmentation of the intracranial artery (IA) in digital subtra...

ConsInstancy: Learning Instance Representations for Semi-Supervised Panoptic Segmentation of Concrete Aggregate Particles

We present a semi-supervised method for panoptic segmentation based on C...

Semi supervised segmentation and graph-based tracking of 3D nuclei in time-lapse microscopy

We propose a novel weakly supervised method to improve the boundary of t...

Please sign up or login with your details

Forgot password? Click here to reset