Path-Restore: Learning Network Path Selection for Image Restoration

04/23/2019
by   Xintao Wang, et al.
10

Very deep Convolutional Neural Networks (CNNs) have greatly improved the performance on various image restoration tasks. However, this comes at a price of increasing computational burden, which limits their practical usages. We believe that some corrupted image regions are inherently easier to restore than others since the distortion and content vary within an image. To this end, we propose Path-Restore, a multi-path CNN with a pathfinder that could dynamically select an appropriate route for each image region. We train the pathfinder using reinforcement learning with a difficulty-regulated reward, which is related to the performance, complexity and "the difficulty of restoring a region". We conduct experiments on denoising and mixed restoration tasks. The results show that our method could achieve comparable or superior performance to existing approaches with less computational cost. In particular, our method is effective for real-world denoising, where the noise distribution varies across different regions of a single image. We surpass the state-of-the-art CBDNet by 0.94 dB and run 29 Models and codes will be released.

READ FULL TEXT

page 1

page 3

page 6

page 7

page 8

research
11/14/2022

CurvPnP: Plug-and-play Blind Image Restoration with Deep Curvature Denoiser

Due to the development of deep learning-based denoisers, the plug-and-pl...
research
12/05/2016

On-Demand Learning for Deep Image Restoration

While machine learning approaches to image restoration offer great promi...
research
04/10/2018

Crafting a Toolchain for Image Restoration by Deep Reinforcement Learning

We investigate a novel approach for image restoration by reinforcement l...
research
12/07/2022

Selector-Enhancer: Learning Dynamic Selection of Local and Non-local Attention Operation for Speech Enhancement

Attention mechanisms, such as local and non-local attention, play a fund...
research
11/10/2022

ClassPruning: Speed Up Image Restoration Networks by Dynamic N:M Pruning

Image restoration tasks have achieved tremendous performance improvement...
research
05/12/2017

Self-Committee Approach for Image Restoration Problems using Convolutional Neural Network

There have been many discriminative learning methods using convolutional...
research
04/10/2022

Simple Baselines for Image Restoration

Although there have been significant advances in the field of image rest...

Please sign up or login with your details

Forgot password? Click here to reset