Unsupervised domain adaptation for cross-modality liver segmentation via joint adversarial learning and self-learning

by   Jin Hong, et al.

Liver segmentation on images acquired using computed tomography (CT) and magnetic resonance imaging (MRI) plays an important role in clinical management of liver diseases. Compared to MRI, CT images of liver are more abundant and readily available. However, MRI can provide richer quantitative information of the liver compared to CT. Thus, it is desirable to achieve unsupervised domain adaptation for transferring the learned knowledge from the source domain containing labeled CT images to the target domain containing unlabeled MR images. In this work, we report a novel unsupervised domain adaptation framework for cross-modality liver segmentation via joint adversarial learning and self-learning. We propose joint semantic-aware and shape-entropy-aware adversarial learning with post-situ identification manner to implicitly align the distribution of task-related features extracted from the target domain with those from the source domain. In proposed framework, a network is trained with the above two adversarial losses in an unsupervised manner, and then a mean completer of pseudo-label generation is employed to produce pseudo-labels to train the next network (desired model). Additionally, semantic-aware adversarial learning and two self-learning methods, including pixel-adaptive mask refinement and student-to-partner learning, are proposed to train the desired model. To improve the robustness of the desired model, a low-signal augmentation function is proposed to transform MRI images as the input of the desired model to handle hard samples. Using the public data sets, our experiments demonstrated the proposed unsupervised domain adaptation framework outperformed four supervised learning methods with a Dice score 0.912 plus or minus 0.037 (mean plus or minus standard deviation).


page 9

page 11

page 12

page 13

page 18

page 20

page 23


Source-free unsupervised domain adaptation for cross-modality abdominal multi-organ segmentation

It is valuable to achieve domain adaptation to transfer the learned know...

Self-semantic contour adaptation for cross modality brain tumor segmentation

Unsupervised domain adaptation (UDA) between two significantly disparate...

Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks

Anisotropic multi-slice Cardiac Magnetic Resonance (CMR) Images are conv...

Generative Self-training for Cross-domain Unsupervised Tagged-to-Cine MRI Synthesis

Self-training based unsupervised domain adaptation (UDA) has shown great...

Adaptation to CT Reconstruction Kernels by Enforcing Cross-domain Feature Maps Consistency

Deep learning methods provide significant assistance in analyzing corona...

Learning to In-paint: Domain Adaptive Shape Completion for 3D Organ Segmentation

We aim at incorporating explicit shape information into current 3D organ...

Harmonizing Flows: Unsupervised MR harmonization based on normalizing flows

In this paper, we propose an unsupervised framework based on normalizing...

Please sign up or login with your details

Forgot password? Click here to reset