Dynamic MLP for MRI Reconstruction

by   Chi Zhang, et al.

As convolutional neural networks (CNN) become the most successful reconstruction technique for accelerated Magnetic Resonance Imaging (MRI), CNN reaches its limit on image quality especially in sharpness. Further improvement on image quality often comes at massive computational costs, hindering their practicability in the clinic setting. MRI reconstruction is essentially a deconvolution problem, which demands long-distance information that is difficult to be captured by CNNs with small convolution kernels. The multi-layer perceptron (MLP) is able to model such long-distance information, but it restricts a fixed input size while the reconstruction of images in flexible resolutions is required in the clinic setting. In this paper, we proposed a hybrid CNN and MLP reconstruction strategy, featured by dynamic MLP (dMLP) that accepts arbitrary image sizes. Experiments were conducted using 3D multi-coil MRI. Our results suggested the proposed dMLP can improve image sharpness compared to its pure CNN counterpart, while costing minor additional GPU memory and computation time. We further compared the proposed dMLP with CNNs using large kernels and studied pure MLP-based reconstruction using a stack of 1D dMLPs, as well as its CNN counterpart using only 1D convolutions. We observed the enlarged receptive field has noticeably improved image quality, while simply using CNN with a large kernel leads to difficulties in training. Noticeably, the pure MLP-based method has been outperformed by CNN-involved methods, which matches the observations in other computer vision tasks for natural images.


page 2

page 5

page 9


Learning Optimal K-space Acquisition and Reconstruction using Physics-Informed Neural Networks

The inherent slow imaging speed of Magnetic Resonance Image (MRI) has sp...

Image Reconstruction for Accelerated MR Scan with Faster Fourier Convolutional Neural Networks

Partial scan is a common approach to accelerate Magnetic Resonance Imagi...

Performance characterization of a novel deep learning-based MR image reconstruction pipeline

A novel deep learning-based magnetic resonance imaging reconstruction pi...

Scan Specific Artifact Reduction in K-space (SPARK) Neural Networks Synergize with Physics-based Reconstruction to Accelerate MRI

Purpose: To develop a scan-specific model that estimates and corrects k-...

ODE-based Deep Network for MRI Reconstruction

Fast data acquisition in Magnetic Resonance Imaging (MRI) is vastly in d...

Encoding Enhanced Complex CNN for Accurate and Highly Accelerated MRI

Magnetic resonance imaging (MRI) using hyperpolarized noble gases provid...

Attention-gated convolutional neural networks for off-resonance correction of spiral real-time MRI

Spiral acquisitions are preferred in real-time MRI because of their effi...

Please sign up or login with your details

Forgot password? Click here to reset