Towards the Detection of Diffusion Model Deepfakes

10/26/2022
by   Jonas Ricker, et al.
0

Diffusion models (DMs) have recently emerged as a promising method in image synthesis. They have surpassed generative adversarial networks (GANs) in both diversity and quality, and have achieved impressive results in text-to-image and image-to-image modeling. However, to date, only little attention has been paid to the detection of DM-generated images, which is critical to prevent adverse impacts on our society. Although prior work has shown that GAN-generated images can be reliably detected using automated methods, it is unclear whether the same methods are effective against DMs. In this work, we address this challenge and take a first look at detecting DM-generated images. We approach the problem from two different angles: First, we evaluate the performance of state-of-the-art detectors on a variety of DMs. Second, we analyze DM-generated images in the frequency domain and study different factors that influence the spectral properties of these images. Most importantly, we demonstrate that GANs and DMs produce images with different characteristics, which requires adaptation of existing classifiers to ensure reliable detection. We believe this work provides the foundation and starting point for further research to detect DM deepfakes effectively.

READ FULL TEXT

page 6

page 7

page 8

page 14

page 18

page 19

page 20

page 23

research
12/23/2021

Comparison and Analysis of Image-to-Image Generative Adversarial Networks: A Survey

Generative Adversarial Networks (GANs) have recently introduced effectiv...
research
03/19/2020

GIQA: Generated Image Quality Assessment

Generative adversarial networks (GANs) have achieved impressive results ...
research
04/18/2023

Look ATME: The Discriminator Mean Entropy Needs Attention

Generative adversarial networks (GANs) are successfully used for image s...
research
03/20/2023

Automatic Measures for Evaluating Generative Design Methods for Architects

The recent explosion of high-quality image-to-image methods has prompted...
research
08/10/2020

T-GD: Transferable GAN-generated Images Detection Framework

Recent advancements in Generative Adversarial Networks (GANs) enable the...
research
03/01/2023

Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models

The image deepfake detection task has been greatly addressed by the scie...
research
03/09/2023

Detecting Images Generated by Diffusers

This paper explores the task of detecting images generated by text-to-im...

Please sign up or login with your details

Forgot password? Click here to reset