Flow-based Deformation Guidance for Unpaired Multi-Contrast MRI Image-to-Image Translation

by   Toan Duc Bui, et al.

Image synthesis from corrupted contrasts increases the diversity of diagnostic information available for many neurological diseases. Recently the image-to-image translation has experienced significant levels of interest within medical research, beginning with the successful use of the Generative Adversarial Network (GAN) to the introduction of cyclic constraint extended to multiple domains. However, in current approaches, there is no guarantee that the mapping between the two image domains would be unique or one-to-one. In this paper, we introduce a novel approach to unpaired image-to-image translation based on the invertible architecture. The invertible property of the flow-based architecture assures a cycle-consistency of image-to-image translation without additional loss functions. We utilize the temporal information between consecutive slices to provide more constraints to the optimization for transforming one domain to another in unpaired volumetric medical images. To capture temporal structures in the medical images, we explore the displacement between the consecutive slices using a deformation field. In our approach, the deformation field is used as a guidance to keep the translated slides realistic and consistent across the translation. The experimental results have shown that the synthesized images using our proposed approach are able to archive a competitive performance in terms of mean squared error, peak signal-to-noise ratio, and structural similarity index when compared with the existing deep learning-based methods on three standard datasets, i.e. HCP, MRBrainS13, and Brats2019.


The effect of loss function on conditional generative adversarial networks

Conditional Generative Adversarial Network (cGAN) is a general purpose a...

Learning a Self-inverse Network for Unpaired Bidirectional Image-to-image Translation

Recently image-to-image translation has attracted significant interests ...

Desmoking laparoscopy surgery images using an image-to-image translation guided by an embedded dark channel

In laparoscopic surgery, the visibility in the image can be severely deg...

cGANs for Cartoon to Real-life Images

The image-to-image translation is a learning task to establish a visual ...

Hue-Net: Intensity-based Image-to-Image Translation with Differentiable Histogram Loss Functions

We present the Hue-Net - a novel Deep Learning framework for Intensity-b...

Harmonic Unpaired Image-to-image Translation

The recent direction of unpaired image-to-image translation is on one ha...

Artifact Reduction in Fundus Imaging using Cycle Consistent Adversarial Neural Networks

Fundus images are very useful in identifying various ophthalmic disorder...

Please sign up or login with your details

Forgot password? Click here to reset