Nonlinear motion separation via untrained generator networks with disentangled latent space variables and applications to cardiac MRI

by   Abdullah, et al.

In this paper, a nonlinear approach to separate different motion types in video data is proposed. This is particularly relevant in dynamic medical imaging (e.g. PET, MRI), where patient motion poses a significant challenge due to its effects on the image reconstruction as well as for its subsequent interpretation. Here, a new method is proposed where dynamic images are represented as the forward mapping of a sequence of latent variables via a generator neural network. The latent variables are structured so that temporal variations in the data are represented via dynamic latent variables, which are independent of static latent variables characterizing the general structure of the frames. In particular, different kinds of motion are also characterized independently of each other via latent space disentanglement using one-dimensional prior information on all but one of the motion types. This representation allows to freeze any selection of motion types, and to obtain accurate independent representations of other dynamics of interest. Moreover, the proposed algorithm is training-free, i.e., all the network parameters are learned directly from a single video. We illustrate the performance of this method on phantom and real-data MRI examples, where we successfully separate respiratory and cardiac motion.


page 5

page 6

page 8

page 12

page 13


Time-Dependent Deep Image Prior for Dynamic MRI

We propose a novel unsupervised deep-learning-based algorithm to solve t...

A Review of Dynamic Network Models with Latent Variables

We present a selective review on statistical modeling of dynamic network...

Dynamic imaging using motion-compensated smoothness regularization on manifolds (MoCo-SToRM)

We introduce an unsupervised deep manifold learning algorithm for motion...

Clustering by Directly Disentangling Latent Space

To overcome the high dimensionality of data, learning latent feature rep...

Efficient training for future video generation based on hierarchical disentangled representation of latent variables

Generating videos predicting the future of a given sequence has been an ...

Joint alignment and reconstruction of multislice dynamic MRI using variational manifold learning

Free-breathing cardiac MRI schemes are emerging as competitive alternati...

Probabilistic Meta-Representations Of Neural Networks

Existing Bayesian treatments of neural networks are typically characteri...

Please sign up or login with your details

Forgot password? Click here to reset