ASL to PET Translation by a Semi-supervised Residual-based Attention-guided Convolutional Neural Network

by   Sahar Yousefi, et al.

Positron Emission Tomography (PET) is an imaging method that can assess physiological function rather than structural disturbances by measuring cerebral perfusion or glucose consumption. However, this imaging technique relies on injection of radioactive tracers and is expensive. On the contrary, Arterial Spin Labeling (ASL) MRI is a non-invasive, non-radioactive, and relatively cheap imaging technique for brain hemodynamic measurements, which allows quantification to some extent. In this paper we propose a convolutional neural network (CNN) based model for translating ASL to PET images, which could benefit patients as well as the healthcare system in terms of expenses and adverse side effects. However, acquiring a sufficient number of paired ASL-PET scans for training a CNN is prohibitive for many reasons. To tackle this problem, we present a new semi-supervised multitask CNN which is trained on both paired data, i.e. ASL and PET scans, and unpaired data, i.e. only ASL scans, which alleviates the problem of training a network on limited paired data. Moreover, we present a new residual-based-attention guided mechanism to improve the contextual features during the training process. Also, we show that incorporating T1-weighted scans as an input, due to its high resolution and availability of anatomical information, improves the results. We performed a two-stage evaluation based on quantitative image metrics by conducting a 7-fold cross validation followed by a double-blind observer study. The proposed network achieved structural similarity index measure (SSIM), mean squared error (MSE) and peak signal-to-noise ratio (PSNR) values of 0.85±0.08, 0.01±0.01, and 21.8±4.5 respectively, for translating from 2D ASL and T1-weighted images to PET data. The proposed model is publicly available via


page 1

page 3

page 6

page 7


Accelerating Prostate Diffusion Weighted MRI using Guided Denoising Convolutional Neural Network: Retrospective Feasibility Study

Purpose: To investigate feasibility of accelerating prostate diffusion-w...

Fast Dynamic Perfusion and Angiography Reconstruction using an end-to-end 3D Convolutional Neural Network

Hadamard time-encoded pseudo-continuous arterial spin labeling (te-pCASL...

Enhanced generative adversarial network for 3D brain MRI super-resolution

Single image super-resolution (SISR) reconstruction for magnetic resonan...

Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation

We consider the problem of segmenting a biomedical image into anatomical...

Superresolution and Segmentation of OCT scans using Multi-Stage adversarial Guided Attention Training

Optical coherence tomography (OCT) is one of the non-invasive and easy-t...

Esophageal Tumor Segmentation in CT Images using a 3D Convolutional Neural Network

Manual or automatic delineation of the esophageal tumor in CT images is ...

MDAESF: Cine MRI Reconstruction Based on Motion-Guided Deformable Alignment and Efficient Spatiotemporal Self-Attention Fusion

Cine MRI can jointly obtain the continuous influence of the anatomical s...

Please sign up or login with your details

Forgot password? Click here to reset