Deep Complementary Joint Model for Complex Scene Registration and Few-shot Segmentation on Medical Images

by   Yuting He, et al.

Deep learning-based medical image registration and segmentation joint models utilize the complementarity (augmentation data or weakly supervised data from registration, region constraints from segmentation) to bring mutual improvement in complex scene and few-shot situation. However, further adoption of the joint models are hindered: 1) the diversity of augmentation data is reduced limiting the further enhancement of segmentation, 2) misaligned regions in weakly supervised data disturb the training process, 3) lack of label-based region constraints in few-shot situation limits the registration performance. We propose a novel Deep Complementary Joint Model (DeepRS) for complex scene registration and few-shot segmentation. We embed a perturbation factor in the registration to increase the activity of deformation thus maintaining the augmentation data diversity. We take a pixel-wise discriminator to extract alignment confidence maps which highlight aligned regions in weakly supervised data so the misaligned regions' disturbance will be suppressed via weighting. The outputs from segmentation model are utilized to implement deep-based region constraints thus relieving the label requirements and bringing fine registration. Extensive experiments on the CT dataset of MM-WHS 2017 Challenge show great advantages of our DeepRS that outperforms the existing state-of-the-art models.


page 6

page 12

page 13


AdLER: Adversarial Training with Label Error Rectification for One-Shot Medical Image Segmentation

Accurate automatic segmentation of medical images typically requires lar...

Mutual information neural estimation in CNN-based end-to-end medical image registration

Image registration is one of the most underlined processes in medical im...

CAR-Net: Unsupervised Co-Attention Guided Registration Network for Joint Registration and Structure Learning

Image registration is a fundamental building block for various applicati...

A Deep Discontinuity-Preserving Image Registration Network

Image registration aims to establish spatial correspondence across pairs...

A weakly supervised registration-based framework for prostate segmentation via the combination of statistical shape model and CNN

Precise determination of target is an essential procedure in prostate in...

Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine

CT and MRI are two of the most informative modalities in spinal diagnost...

𝒳-Metric: An N-Dimensional Information-Theoretic Framework for Groupwise Registration and Deep Combined Computing

This paper presents a generic probabilistic framework for estimating the...

Please sign up or login with your details

Forgot password? Click here to reset