MDT-Net: Multi-domain Transfer by Perceptual Supervision for Unpaired Images in OCT Scan

by   Weinan Song, et al.

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or adaptation. However, with the absence of paired and annotated images, most domain transfer methods mainly rely on adversarial networks and weak cycle consistency, which could result in incomplete domain transfer or poor adherence to the original image content. In this paper, we introduce MDT-Net to address the limitations above through a multi-domain transfer model based on perceptual supervision. Specifically, our model consists of an encoder-decoder network, which aims to preserve anatomical structures, and multiple domain-specific transfer modules, which guide the domain transition through feature transformation. During the inference, MDT-Net can directly transfer images from the source domain to multiple target domains at one time without any reference image. To demonstrate the performance of MDT-Net, we evaluate it on RETOUCH dataset, comprising OCT scans from three different scanner devices (domains), for multi-domain transfer. We also take the transformed results as additional training images for fluid segmentation in OCT scans in the tasks of domain adaptation and data augmentation. Experimental results show that MDT-Net can outperform other domain transfer models qualitatively and quantitatively. Furthermore, the significant improvement in dice scores over multiple segmentation models also demonstrates the effectiveness and efficiency of our proposed method.


page 3

page 4


Domain-Agnostic Learning with Anatomy-Consistent Embedding for Cross-Modality Liver Segmentation

Domain Adaptation (DA) has the potential to greatly help the generalizat...

ADAS: A Direct Adaptation Strategy for Multi-Target Domain Adaptive Semantic Segmentation

In this paper, we present a direct adaptation strategy (ADAS), which aim...

Multi-Scale Multi-Target Domain Adaptation for Angle Closure Classification

Deep learning (DL) has made significant progress in angle closure classi...

Tissue Segmentation of Thick-Slice Fetal Brain MR Scans with Guidance from High-Quality Isotropic Volumes

Accurate tissue segmentation of thick-slice fetal brain magnetic resonan...

Generalisable Cardiac Structure Segmentation via Attentional and Stacked Image Adaptation

Tackling domain shifts in multi-centre and multi-vendor data sets remain...

Deep-based quality assessment of medical images through domain adaptation

Predicting the quality of multimedia content is often needed in differen...

Please sign up or login with your details

Forgot password? Click here to reset