Iterative Residual CNNs for Burst Photography Applications

by   Filippos Kokkinos, et al.

Modern inexpensive imaging sensors suffer from inherent hardware constraints which often result in captured images of poor quality. Among the most common ways to deal with such limitations is to rely on burst photography, which nowadays acts as the backbone of all modern smartphone imaging applications. In this work, we focus on the fact that every frame of a burst sequence can be accurately described by a forward (physical) model. This in turn allows us to restore a single image of higher quality from a sequence of low quality images as the solution of an optimization problem. Inspired by an extension of the gradient descent method that can handle non-smooth functions, namely the proximal gradient descent, and modern deep learning techniques, we propose a convolutional iterative network with a transparent architecture. Our network, uses a burst of low quality image frames and is able to produce an output of higher image quality recovering fine details which are not distinguishable in any of the original burst frames. We focus both on the burst photography pipeline as a whole, i.e. burst demosaicking and denoising, as well as on the traditional Gaussian denoising task. The developed method demonstrates consistent state-of-the art performance across the two tasks and as opposed to other recent deep learning approaches does not have any inherent restrictions either to the number of frames or their ordering.


page 2

page 9


Deformed2Self: Self-Supervised Denoising for Dynamic Medical Imaging

Image denoising is of great importance for medical imaging system, since...

Residual Learning for Effective joint Demosaicing-Denoising

Image demosaicing and denoising are key steps for color image production...

Iterative Residual Network for Deep Joint Image Demosaicking and Denoising

Modern digital cameras rely on sequential execution of separate image pr...

RBSRICNN: Raw Burst Super-Resolution through Iterative Convolutional Neural Network

Modern digital cameras and smartphones mostly rely on image signal proce...

Speckles-Training-Based Denoising Convolutional Neural Network Ghost Imaging

Ghost imaging (GI) has been paid attention gradually because of its lens...

Chromatic Aberration Recovery on Arbitrary Images

Digital imaging sensor technology has continued to outpace development i...

Please sign up or login with your details

Forgot password? Click here to reset