Foreground color prediction through inverse compositing

03/24/2021
by   Sebastian Lutz, et al.
1

In natural image matting, the goal is to estimate the opacity of the foreground object in the image. This opacity controls the way the foreground and background is blended in transparent regions. In recent years, advances in deep learning have led to many natural image matting algorithms that have achieved outstanding performance in a fully automatic manner. However, most of these algorithms only predict the alpha matte from the image, which is not sufficient to create high-quality compositions. Further, it is not possible to manually interact with these algorithms in any way except by directly changing their input or output. We propose a novel recurrent neural network that can be used as a post-processing method to recover the foreground and background colors of an image, given an initial alpha estimation. Our method outperforms the state-of-the-art in color estimation for natural image matting and show that the recurrent nature of our method allows users to easily change candidate solutions that lead to superior color estimations.

READ FULL TEXT

page 3

page 4

page 6

page 7

research
06/26/2020

Fast Multi-Level Foreground Estimation

Alpha matting aims to estimate the translucency of an object in a given ...
research
06/05/2023

Color-aware Deep Temporal Backdrop Duplex Matting System

Deep learning-based alpha matting showed tremendous improvements in rece...
research
03/17/2020

F, B, Alpha Matting

Cutting out an object and estimating its opacity mask, known as image ma...
research
06/23/2023

Magenta Green Screen: Spectrally Multiplexed Alpha Matting with Deep Colorization

We introduce Magenta Green Screen, a novel machine learning–enabled matt...
research
11/04/2020

Deep Image Compositing

Image compositing is a task of combining regions from different images t...
research
03/31/2021

Human Perception Modeling for Automatic Natural Image Matting

Natural image matting aims to precisely separate foreground objects from...
research
09/20/2019

Context-Aware Image Matting for Simultaneous Foreground and Alpha Estimation

Natural image matting is an important problem in computer vision and gra...

Please sign up or login with your details

Forgot password? Click here to reset