KidneyRegNet: A Deep Learning Method for 3DCT-2DUS Kidney Registration during Breathing

by   Chi Yanling, et al.

This work proposed a novel deep registration pipeline for 3D CT and 2D U/S kidney scans of free breathing, which consists of a feature network, and a 3D-2D CNN-based registration network. The feature network has handcraft texture feature layers to reduce the semantic gap. The registration network is encoder-decoder structure with loss of feature-image-motion (FIM), which enables hierarchical regression at decoder layers and avoids multiple network concatenation. It was first pretrained with retrospective datasets cum training data generation strategy, then adapted to specific patient data under unsupervised one-cycle transfer learning in onsite application. The experiment was on 132 U/S sequences, 39 multiple phase CT and 210 public single phase CT images, and 25 pairs of CT and U/S sequences. It resulted in mean contour distance (MCD) of 0.94 mm between kidneys on CT and U/S images and MCD of 1.15 mm on CT and reference CT images. For datasets with small transformations, it resulted in MCD of 0.82 and 1.02 mm respectively. For large transformations, it resulted in MCD of 1.10 and 1.28 mm respectively. This work addressed difficulties in 3DCT-2DUS kidney registration during free breathing via novel network structures and training strategy.


page 3

page 8

page 9

page 12

page 15


3D Convolutional Neural Networks Image Registration Based on Efficient Supervised Learning from Artificial Deformations

We propose a supervised nonrigid image registration method, trained usin...

A Cross-Stitch Architecture for Joint Registration and Segmentation in Adaptive Radiotherapy

Recently, joint registration and segmentation has been formulated in a d...

RMSim: Controlled Respiratory Motion Simulation on Static Patient Scans

This work aims to generate realistic anatomical deformations from static...

Quantitative Error Prediction of Medical Image Registration using Regression Forests

Predicting registration error can be useful for evaluation of registrati...

Train smarter, not harder: learning deep abdominal CT registration on scarce data

Purpose: This study aims to explore training strategies to improve convo...

Reducing the Human Effort in Developing PET-CT Registration

We aim to reduce the tedious nature of developing and evaluating methods...

Please sign up or login with your details

Forgot password? Click here to reset