Multi-Task Spatiotemporal Neural Networks for Structured Surface Reconstruction

by   Mingze Xu, et al.

Deep learning methods have surpassed the performance of traditional techniques on a wide range of problems in computer vision, but nearly all of this work has studied consumer photos, where precisely correct output is often not critical. It is less clear how well these techniques may apply on structured prediction problems where fine-grained output with high precision is required, such as in scientific imaging domains. Here we consider the problem of segmenting echogram radar data collected from the polar ice sheets, which is challenging because segmentation boundaries are often very weak and there is a high degree of noise. We propose a multi-task spatiotemporal neural network that combines 3D ConvNets and Recurrent Neural Networks (RNNs) to estimate ice surface boundaries from sequences of tomographic radar images. We show that our model outperforms the state-of-the-art on this problem by (1) avoiding the need for hand-tuned parameters, (2) extracting multiple surfaces (ice-air and ice-bed) simultaneously, (3) requiring less non-visual metadata, and (4) being about 6 times faster.


page 1

page 5

page 6

page 7


Automatic Estimation of Ice Bottom Surfaces from Radar Imagery

Ground-penetrating radar on planes and satellites now makes it practical...

Joint Air Quality and Weather Prediction Based on Multi-Adversarial Spatiotemporal Networks

Accurate and timely air quality and weather predictions are of great imp...

A Multi-task Two-stream Spatiotemporal Convolutional Neural Network for Convective Storm Nowcasting

The goal of convective storm nowcasting is local prediction of severe an...

Deep Tiered Image Segmentation forDetecting Internal Ice Layers in Radar Imagery

Understanding the structure of the ice at the Earth's poles is important...

Multi-task Learning Approach for Automatic Modulation and Wireless Signal Classification

Wireless signal recognition is becoming increasingly more significant fo...

Computer vision-based recognition of liquid surfaces and phase boundaries in transparent vessels, with emphasis on chemistry applications

The ability to recognize the liquid surface and the liquid level in tran...

Please sign up or login with your details

Forgot password? Click here to reset