To Beta or Not To Beta: Information Bottleneck for DigitaL Image Forensics

08/11/2019
by   Aurobrata Ghosh, et al.
4

We consider an information theoretic approach to address the problem of identifying fake digital images. We propose an innovative method to formulate the issue of localizing manipulated regions in an image as a deep representation learning problem using the Information Bottleneck (IB), which has recently gained popularity as a framework for interpreting deep neural networks. Tampered images pose a serious predicament since digitized media is a ubiquitous part of our lives. These are facilitated by the easy availability of image editing software and aggravated by recent advances in deep generative models such as GANs. We propose InfoPrint, a computationally efficient solution to the IB formulation using approximate variational inference and compare it to a numerical solution that is computationally expensive. Testing on a number of standard datasets, we demonstrate that InfoPrint outperforms the state-of-the-art and the numerical solution. Additionally, it also has the ability to detect alterations made by inpainting GANs.

READ FULL TEXT

page 7

page 8

research
07/11/2022

Bottlenecks CLUB: Unifying Information-Theoretic Trade-offs Among Complexity, Leakage, and Utility

Bottleneck problems are an important class of optimization problems that...
research
02/22/2022

Model2Detector: Widening the Information Bottleneck for Out-of-Distribution Detection using a Handful of Gradient Steps

Out-of-distribution detection is an important capability that has long e...
research
11/20/2018

Attributing Fake Images to GANs: Analyzing Fingerprints in Generated Images

Research in computer graphics has been in pursuit of realistic image gen...
research
11/30/2018

Void Filling of Digital Elevation Models with Deep Generative Models

In recent years, advances in machine learning algorithms, cheap computat...
research
01/17/2017

Image Generation and Editing with Variational Info Generative AdversarialNetworks

Recently there has been an enormous interest in generative models for im...
research
11/03/2022

Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models

During image editing, existing deep generative models tend to re-synthes...

Please sign up or login with your details

Forgot password? Click here to reset