Robust Deep Compressive Sensing with Recurrent-Residual Structural Constraints

07/15/2022
by   Jun Niu, et al.
9

Existing deep compressive sensing (CS) methods either ignore adaptive online optimization or depend on costly iterative optimizer during reconstruction. This work explores a novel image CS framework with recurrent-residual structural constraint, termed as R^2CS-NET. The R^2CS-NET first progressively optimizes the acquired samplings through a novel recurrent neural network. The cascaded residual convolutional network then fully reconstructs the image from optimized latent representation. As the first deep CS framework efficiently bridging adaptive online optimization, the R^2CS-NET integrates the robustness of online optimization with the efficiency and nonlinear capacity of deep learning methods. Signal correlation has been addressed through the network architecture. The adaptive sensing nature further makes it an ideal candidate for color image CS via leveraging channel correlation. Numerical experiments verify the proposed recurrent latent optimization design not only fulfills the adaptation motivation, but also outperforms classic long short-term memory (LSTM) architecture in the same scenario. The overall framework demonstrates hardware implementation feasibility, with leading robustness and generalization capability among existing deep CS benchmarks.

READ FULL TEXT

page 1

page 5

page 6

page 8

page 9

page 10

research
02/26/2019

MC-ISTA-Net: Adaptive Measurement and Initialization and Channel Attention Optimization inspired Neural Network for Compressive Sensing

The optimization inspired network can bridge convex optimization and neu...
research
01/31/2018

ConvCSNet: A Convolutional Compressive Sensing Framework Based on Deep Learning

Compressive sensing (CS), aiming to reconstruct an image/signal from a s...
research
04/21/2020

AMP-Net: Denoising based Deep Unfolding for Compressive Image Sensing

Most compressive sensing (CS) reconstruction methods can be divided into...
research
06/24/2017

ISTA-Net: Iterative Shrinkage-Thresholding Algorithm Inspired Deep Network for Image Compressive Sensing

Traditional methods for image compressive sensing (CS) reconstruction so...
research
03/21/2022

Adaptive and Cascaded Compressive Sensing

Scene-dependent adaptive compressive sensing (CS) has been a long pursui...
research
05/06/2023

NL-CS Net: Deep Learning with Non-Local Prior for Image Compressive Sensing

Deep learning has been applied to compressive sensing (CS) of images suc...
research
03/22/2021

ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensing

While deep neural networks have achieved impressive success in image com...

Please sign up or login with your details

Forgot password? Click here to reset