An Attentive-based Generative Model for Medical Image Synthesis

by   Jiayuan Wang, et al.

Magnetic resonance (MR) and computer tomography (CT) imaging are valuable tools for diagnosing diseases and planning treatment. However, limitations such as radiation exposure and cost can restrict access to certain imaging modalities. To address this issue, medical image synthesis can generate one modality from another, but many existing models struggle with high-quality image synthesis when multiple slices are present in the dataset. This study proposes an attention-based dual contrast generative model, called ADC-cycleGAN, which can synthesize medical images from unpaired data with multiple slices. The model integrates a dual contrast loss term with the CycleGAN loss to ensure that the synthesized images are distinguishable from the source domain. Additionally, an attention mechanism is incorporated into the generators to extract informative features from both channel and spatial domains. To improve performance when dealing with multiple slices, the K-means algorithm is used to cluster the dataset into K groups, and each group is used to train a separate ADC-cycleGAN. Experimental results demonstrate that the proposed ADC-cycleGAN model produces comparable samples to other state-of-the-art generative models, achieving the highest PSNR and SSIM values of 19.04385 and 0.68551, respectively. We publish the code at


page 7

page 11

page 19


DC-cycleGAN: Bidirectional CT-to-MR Synthesis from Unpaired Data

Magnetic resonance (MR) and computer tomography (CT) images are two typi...

Dual Adversarial Learning with Attention Mechanism for Fine-grained Medical Image Synthesis

Medical imaging plays a critical role in various clinical applications. ...

Paired-Unpaired Unsupervised Attention Guided GAN with Transfer Learning for Bidirectional Brain MR-CT Synthesis

Medical image acquisition plays a significant role in the diagnosis and ...

DUAL-GLOW: Conditional Flow-Based Generative Model for Modality Transfer

Positron emission tomography (PET) imaging is an imaging modality for di...

SkrGAN: Sketching-rendering Unconditional Generative Adversarial Networks for Medical Image Synthesis

Generative Adversarial Networks (GANs) have the capability of synthesizi...

Deep Embedding Convolutional Neural Network for Synthesizing CT Image from T1-Weighted MR Image

Recently, more and more attention is drawn to the field of medical image...

Unsupervised learning for cross-domain medical image synthesis using deformation invariant cycle consistency networks

Recently, the cycle-consistent generative adversarial networks (CycleGAN...

Please sign up or login with your details

Forgot password? Click here to reset