Cross-modality image synthesis from unpaired data using CycleGAN: Effects of gradient consistency loss and training data size

03/18/2018
by   Yuta Hiasa, et al.
0

CT is commonly used in orthopedic procedures. MRI is used along with CT to identify muscle structures and diagnose osteonecrosis due to its superior soft tissue contrast. However, MRI has poor contrast for bone structures. Clearly, it would be helpful if a corresponding CT were available, as bone boundaries are more clearly seen and CT has standardized (i.e., Hounsfield) units. Therefore, we aim at MR-to-CT synthesis. The CycleGAN was successfully applied to unpaired CT and MR images of the head, these images do not have as much variation of intensity pairs as do images in the pelvic region due to the presence of joints and muscles. In this paper, we extended the CycleGAN approach by adding the gradient consistency loss to improve the accuracy at the boundaries. We conducted two experiments. To evaluate image synthesis, we investigated dependency of image synthesis accuracy on 1) the number of training data and 2) the gradient consistency loss. To demonstrate the applicability of our method, we also investigated a segmentation accuracy on synthesized images.

READ FULL TEXT

page 3

page 5

page 6

page 7

research
09/10/2019

Integrating cross-modality hallucinated MRI with CT to aid mediastinal lung tumor segmentation

Lung tumors, especially those located close to or surrounded by soft tis...
research
09/12/2018

Unpaired Brain MR-to-CT Synthesis using a Structure-Constrained CycleGAN

The cycleGAN is becoming an influential method in medical image synthesi...
research
11/25/2020

Three-dimensional Segmentation of the Scoliotic Spine from MRI using Unsupervised Volume-based MR-CT Synthesis

Vertebral bone segmentation from magnetic resonance (MR) images is a cha...
research
05/28/2018

Deep CT to MR Synthesis using Paired and Unpaired Data

MR imaging will play a very important role in radiotherapy treatment pla...
research
03/13/2020

Random smooth gray value transformations for cross modality learning with gray value invariant networks

Random transformations are commonly used for augmentation of the trainin...
research
12/11/2018

Evaluating the Impact of Intensity Normalization on MR Image Synthesis

Image synthesis learns a transformation from the intensity features of a...
research
09/23/2017

A semi-automated segmentation method for detection of pulmonary embolism in True-FISP MRI sequences

Pulmonary embolism (PE) is a highly mortal disease, currently assessed b...

Please sign up or login with your details

Forgot password? Click here to reset