ViTBIS: Vision Transformer for Biomedical Image Segmentation

by   abhinavsagar, et al.

In this paper, we propose a novel network named Vision Transformer for Biomedical Image Segmentation (ViTBIS). Our network splits the input feature maps into three parts with 1× 1, 3× 3 and 5× 5 convolutions in both encoder and decoder. Concat operator is used to merge the features before being fed to three consecutive transformer blocks with attention mechanism embedded inside it. Skip connections are used to connect encoder and decoder transformer blocks. Similarly, transformer blocks and multi scale architecture is used in decoder before being linearly projected to produce the output segmentation map. We test the performance of our network using Synapse multi-organ segmentation dataset, Automated cardiac diagnosis challenge dataset, Brain tumour MRI segmentation dataset and Spleen CT segmentation dataset. Without bells and whistles, our network outperforms most of the previous state of the art CNN and transformer based models using Dice score and the Hausdorff distance as the evaluation metrics.


page 8

page 9


A Transformer-based Generative Adversarial Network for Brain Tumor Segmentation

Brain tumor segmentation remains a challenge in medical image segmentati...

Dynamic Linear Transformer for 3D Biomedical Image Segmentation

Transformer-based neural networks have surpassed promising performance o...

MDU-Net: Multi-scale Densely Connected U-Net for biomedical image segmentation

Radiologist is "doctor's doctor", biomedical image segmentation plays a ...

Multi-Stream Transformers

Transformer-based encoder-decoder models produce a fused token-wise repr...

Multi Kernel Positional Embedding ConvNeXt for Polyp Segmentation

Medical image segmentation is the technique that helps doctor view and h...

One Model to Synthesize Them All: Multi-contrast Multi-scale Transformer for Missing Data Imputation

Multi-contrast magnetic resonance imaging (MRI) is widely used in clinic...

Please sign up or login with your details

Forgot password? Click here to reset