JoJoNet: Joint-contrast and Joint-sampling-and-reconstruction Network for Multi-contrast MRI

by   Lin Zhao, et al.

Multi-contrast Magnetic Resonance Imaging (MRI) generates multiple medical images with rich and complementary information for routine clinical use; however, it suffers from a long acquisition time. Recent works for accelerating MRI, mainly designed for single contrast, may not be optimal for multi-contrast scenario since the inherent correlations among the multi-contrast images are not exploited. In addition, independent reconstruction of each contrast usually does not translate to optimal performance of downstream tasks. Motivated by these aspects, in this paper we design an end-to-end framework for accelerating multi-contrast MRI which simultaneously optimizes the entire MR imaging workflow including sampling, reconstruction and downstream tasks to achieve the best overall outcomes. The proposed framework consists of a sampling mask generator for each image contrast and a reconstructor exploiting the inter-contrast correlations with a recurrent structure which enables the information sharing in a holistic way. The sampling mask generator and the reconstructor are trained jointly across the multiple image contrasts. The acceleration ratio of each image contrast is also learnable and can be driven by a downstream task performance. We validate our approach on a multi-contrast brain dataset and a multi-contrast knee dataset. Experiments show that (1) our framework consistently outperforms the baselines designed for single contrast on both datasets; (2) our newly designed recurrent reconstruction network effectively improves the reconstruction quality for multi-contrast images; (3) the learnable acceleration ratio improves the downstream task performance significantly. Overall, this work has potentials to open up new avenues for optimizing the entire multi-contrast MR imaging workflow.


page 1

page 3

page 7

page 8

page 12

page 13


One Network to Solve Them All: A Sequential Multi-Task Joint Learning Network Framework for MR Imaging Pipeline

Magnetic resonance imaging (MRI) acquisition, reconstruction, and segmen...

Coupled Dictionary Learning for Multi-contrast MRI Reconstruction

Medical imaging tasks often involve multiple contrasts, such as T1- and ...

Constrained Probabilistic Mask Learning for Task-specific Undersampled MRI Reconstruction

Undersampling is a common method in Magnetic Resonance Imaging (MRI) to ...

Deep Unfolding Convolutional Dictionary Model for Multi-Contrast MRI Super-resolution and Reconstruction

Magnetic resonance imaging (MRI) tasks often involve multiple contrasts....

Deep Simultaneous Optimisation of Sampling and Reconstruction for Multi-contrast MRI

MRI images of the same subject in different contrasts contain shared inf...

A Deep Information Sharing Network for Multi-contrast Compressed Sensing MRI Reconstruction

In multi-contrast magnetic resonance imaging (MRI), compressed sensing t...

Optimal MRI Undersampling Patterns for Ultimate Benefit of Medical Vision Tasks

To accelerate MRI, the field of compressed sensing is traditionally conc...

Please sign up or login with your details

Forgot password? Click here to reset