Neural Multi-Atlas Label Fusion: Application to Cardiac MR Images

by   Heran Yang, et al.

Multi-atlas segmentation approach is one of the most widely-used image segmentation techniques in biomedical applications. There are two major challenges in this category of methods, i.e., atlas selection and label fusion. In this paper, we propose a novel multi-atlas segmentation method that formulates multi-atlas segmentation in a deep learning framework for better solving these challenges. The proposed method, dubbed deep fusion net (DFN), is a deep architecture that integrates a feature extraction subnet and a non-local patch-based label fusion (NL-PLF) subnet in a single network. The network parameters are learned by end-to-end training strategy for automatically learning deep features that enable optimal performance in a NL-PLF framework. Besides, the learned deep features are further utilized in defining a similarity measure for atlas selection. We evaluate our proposed method on two public cardiac MR databases of SATA-13 and LV-09 for left ventricle segmentation, and our learned DFNs with extracted deep features for atlas selection at testing phase achieve state-of-the-art accuracies, e.g., 0.833 in averaged Dice metric (ADM) on SATA-13 database and 0.95 in ADM for epicardium segmentation on LV-09 database. Besides, our method is robust to the cross-database evaluation, e.g., the DFN learned on LV-09 database achieves 0.815 in ADM on SATA-13 database. We also test our proposed method on Cardiac Atlas Project (CAP) testing set of MICCAI 2013 SATA Segmentation Challenge, and our method achieves 0.815 in Dice metric, ranking as the highest result on this dataset.


page 8

page 16

page 19

page 21

page 25


CompareNet: Anatomical Segmentation Network with Deep Non-local Label Fusion

Label propagation is a popular technique for anatomical segmentation. In...

2D-3D Fully Convolutional Neural Networks for Cardiac MR Segmentation

In this paper, we develop a 2D and 3D segmentation pipelines for fully a...

VoteNet+ : An Improved Deep Learning Label Fusion Method for Multi-atlas Segmentation

In this work, we improve the performance of multi-atlas segmentation (MA...

An Optimized PatchMatch for Multi-scale and Multi-feature Label Fusion

Automatic segmentation methods are important tools for quantitative anal...

Deep nested level sets: Fully automated segmentation of cardiac MR images in patients with pulmonary hypertension

In this paper we introduce a novel and accurate optimisation method for ...

An Automatic Cardiac Segmentation Framework based on Multi-sequence MR Image

LGE CMR is an efficient technology for detecting infarcted myocardium. A...

Please sign up or login with your details

Forgot password? Click here to reset