A Spatiotemporal Volumetric Interpolation Network for 4D Dynamic Medical Image

by   Yuyu Guo, et al.

Dynamic medical imaging is usually limited in application due to the large radiation doses and longer image scanning and reconstruction times. Existing methods attempt to reduce the dynamic sequence by interpolating the volumes between the acquired image volumes. However, these methods are limited to either 2D images and/or are unable to support large variations in the motion between the image volume sequences. In this paper, we present a spatiotemporal volumetric interpolation network (SVIN) designed for 4D dynamic medical images. SVIN introduces dual networks: first is the spatiotemporal motion network that leverages the 3D convolutional neural network (CNN) for unsupervised parametric volumetric registration to derive spatiotemporal motion field from two-image volumes; the second is the sequential volumetric interpolation network, which uses the derived motion field to interpolate image volumes, together with a new regression-based module to characterize the periodic motion cycles in functional organ structures. We also introduce an adaptive multi-scale architecture to capture the volumetric large anatomy motions. Experimental results demonstrated that our SVIN outperformed state-of-the-art temporal medical interpolation methods and natural video interpolation methods that have been extended to support volumetric images. Our ablation study further exemplified that our motion network was able to better represent the large functional motion compared with the state-of-the-art unsupervised medical registration methods.


page 1

page 3

page 4

page 6

page 7

page 8


SearchMorph:Multi-scale Correlation Iterative Network for Deformable Registration

Deformable image registration provides dynamic information about the ima...

TransMorph: Transformer for unsupervised medical image registration

In the last decade, convolutional neural networks (ConvNets) have domina...

Dense Volume-to-Volume Vascular Boundary Detection

In this work, we present a novel 3D-Convolutional Neural Network (CNN) a...

Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images

Motion estimation is a fundamental step in dynamic medical image process...

Disease Detection in Weakly Annotated Volumetric Medical Images using a Convolutional LSTM Network

We explore a solution for learning disease signatures from weakly, yet e...

Accelerating B-spline Interpolation on GPUs: Application to Medical Image Registration

Background and Objective. B-spline interpolation (BSI) is a popular tech...

Registration by tracking for sequential 2D MRI

Our anatomy is in constant motion. With modern MR imaging it is possible...

Please sign up or login with your details

Forgot password? Click here to reset