Joint Chromatic and Polarimetric Demosaicing via Sparse Coding

12/16/2019
by   Sijia Wen, et al.
9

Thanks to the latest progress in image sensor manufacturing technology, the emergence of the single-chip polarized color sensor is likely to bring advantages to computer vision tasks. Despite the importance of the sensor, joint chromatic and polarimetric demosaicing is the key to obtaining the high-quality RGB-Polarization image for the sensor. Since the polarized color sensor is equipped with a new type of chip, the demosaicing problem cannot be currently well-addressed by former methods. In this paper, we propose a joint chromatic and polarimetric demosaicing model to address this challenging problem. To solve this non-convex problem, we further present a sparse representation-based optimization strategy that utilizes chromatic information and polarimetric information to jointly optimize the model. In addition, we build an optical data acquisition system to collect an RGB-Polarization dataset. Results of both qualitative and quantitative experiments have shown that our method is capable of faithfully recovering full 12-channel chromatic and polarimetric information for each pixel from a single mosaic input image. Moreover, we show that the proposed method can perform well not only on the synthetic data but the real captured data.

READ FULL TEXT

page 1

page 4

page 5

page 7

page 8

research
09/27/2022

Simultaneous Acquisition of High Quality RGB Image and Polarization Information using a Sparse Polarization Sensor

This paper proposes a novel polarization sensor structure and network ar...
research
07/28/2020

Monochrome and Color Polarization Demosaicking Using Edge-Aware Residual Interpolation

A division-of-focal-plane or microgrid image polarimeter enables us to a...
research
05/23/2016

Learning Sensor Multiplexing Design through Back-propagation

Recent progress on many imaging and vision tasks has been driven by the ...
research
03/22/2021

Polarization Guided Specular Reflection Separation

Since specular reflection often exists in the real captured images and c...
research
07/23/2022

Event-based RGB-D sensing with structured light

Event-based cameras (ECs) are bio-inspired sensors that asynchronously r...
research
04/28/2021

Hybrid Approach for 3D Head Reconstruction: Using Neural Networks and Visual Geometry

Recovering the 3D geometric structure of a face from a single input imag...
research
12/21/2021

Multispectral image fusion by super pixel statistics

Multispectral image fusion is a fundamental problem of remote sensing an...

Please sign up or login with your details

Forgot password? Click here to reset