Enhancing Medical Image Segmentation with TransCeption: A Multi-Scale Feature Fusion Approach

01/25/2023
by   Reza Azad, et al.
0

While CNN-based methods have been the cornerstone of medical image segmentation due to their promising performance and robustness, they suffer from limitations in capturing long-range dependencies. Transformer-based approaches are currently prevailing since they enlarge the reception field to model global contextual correlation. To further extract rich representations, some extensions of the U-Net employ multi-scale feature extraction and fusion modules and obtain improved performance. Inspired by this idea, we propose TransCeption for medical image segmentation, a pure transformer-based U-shape network featured by incorporating the inception-like module into the encoder and adopting a contextual bridge for better feature fusion. The design proposed in this work is based on three core principles: (1) The patch merging module in the encoder is redesigned with ResInception Patch Merging (RIPM). Multi-branch transformer (MB transformer) adopts the same number of branches as the outputs of RIPM. Combining the two modules enables the model to capture a multi-scale representation within a single stage. (2) We construct an Intra-stage Feature Fusion (IFF) module following the MB transformer to enhance the aggregation of feature maps from all the branches and particularly focus on the interaction between the different channels of all the scales. (3) In contrast to a bridge that only contains token-wise self-attention, we propose a Dual Transformer Bridge that also includes channel-wise self-attention to exploit correlations between scales at different stages from a dual perspective. Extensive experiments on multi-organ and skin lesion segmentation tasks present the superior performance of TransCeption compared to previous work. The code is publicly available at <https://github.com/mindflow-institue/TransCeption>.

READ FULL TEXT

page 1

page 3

page 5

page 8

research
06/02/2022

MISSU: 3D Medical Image Segmentation via Self-distilling TransUNet

U-Nets have achieved tremendous success in medical image segmentation. N...
research
06/27/2023

No-Service Rail Surface Defect Segmentation via Normalized Attention and Dual-scale Interaction

No-service rail surface defect (NRSD) segmentation is an essential way f...
research
07/27/2023

MCPA: Multi-scale Cross Perceptron Attention Network for 2D Medical Image Segmentation

The UNet architecture, based on Convolutional Neural Networks (CNN), has...
research
06/14/2023

M^2UNet: MetaFormer Multi-scale Upsampling Network for Polyp Segmentation

Polyp segmentation has recently garnered significant attention, and mult...
research
10/26/2022

Super-Resolution Based Patch-Free 3D Medical Image Segmentation with Self-Supervised Guidance

High resolution (HR) 3D medical image segmentation plays an important ro...
research
07/16/2023

TransNuSeg: A Lightweight Multi-Task Transformer for Nuclei Segmentation

Nuclei appear small in size, yet, in real clinical practice, the global ...
research
07/29/2022

ScaleFormer: Revisiting the Transformer-based Backbones from a Scale-wise Perspective for Medical Image Segmentation

Recently, a variety of vision transformers have been developed as their ...

Please sign up or login with your details

Forgot password? Click here to reset