TAN: Temporal Affine Network for Real-Time Left Ventricle Anatomical Structure Analysis Based on 2D Ultrasound Videos

by   Sihong Chen, et al.

With superiorities on low cost, portability, and free of radiation, echocardiogram is a widely used imaging modality for left ventricle (LV) function quantification. However, automatic LV segmentation and motion tracking is still a challenging task. In addition to fuzzy border definition, low contrast, and abounding artifacts on typical ultrasound images, the shape and size of the LV change significantly in a cardiac cycle. In this work, we propose a temporal affine network (TAN) to perform image analysis in a warped image space, where the shape and size variations due to the cardiac motion as well as other artifacts are largely compensated. Furthermore, we perform three frequent echocardiogram interpretation tasks simultaneously: standard cardiac plane recognition, LV landmark detection, and LV segmentation. Instead of using three networks with one dedicating to each task, we use a multi-task network to perform three tasks simultaneously. Since three tasks share the same encoder, the compact network improves the segmentation accuracy with more supervision. The network is further finetuned with optical flow adjusted annotations to enhance motion coherence in the segmentation result. Experiments on 1,714 2D echocardiographic sequences demonstrate that the proposed method achieves state-of-the-art segmentation accuracy with real-time efficiency.


page 2

page 3

page 4

page 7

page 8


Multi-task Swin Transformer for Motion Artifacts Classification and Cardiac Magnetic Resonance Image Segmentation

Cardiac Magnetic Resonance Imaging is commonly used for the assessment o...

Left Ventricle Segmentation via Optical-Flow-Net from Short-axis Cine MRI: Preserving the Temporal Coherence of Cardiac Motion

Quantitative assessment of left ventricle (LV) function from cine MRI ha...

LSDM: Long-Short Diffeomorphic Motion for Weakly-Supervised Ultrasound Landmark Tracking

Accurate tracking of an anatomical landmark over time has been of high i...

Uncertainty Estimation in Deep 2D Echocardiography Segmentation

2D echocardiography is the most common imaging modality for cardiovascul...

Spatio-Temporal Segmentation in 3D Echocardiographic Sequences using Fractional Brownian Motion

An important aspect for an improved cardiac functional analysis is the a...

BowNet: Dilated Convolution Neural Network for Ultrasound Tongue Contour Extraction

Ultrasound imaging is safe, relatively affordable, and capable of real-t...

Echocardiography Segmentation Using Neural ODE-based Diffeomorphic Registration Field

Convolutional neural networks (CNNs) have recently proven their excellen...

Please sign up or login with your details

Forgot password? Click here to reset