INDigo: An INN-Guided Probabilistic Diffusion Algorithm for Inverse Problems

06/05/2023
by   Di You, et al.
0

Recently it has been shown that using diffusion models for inverse problems can lead to remarkable results. However, these approaches require a closed-form expression of the degradation model and can not support complex degradations. To overcome this limitation, we propose a method (INDigo) that combines invertible neural networks (INN) and diffusion models for general inverse problems. Specifically, we train the forward process of INN to simulate an arbitrary degradation process and use the inverse as a reconstruction process. During the diffusion sampling process, we impose an additional data-consistency step that minimizes the distance between the intermediate result and the INN-optimized result at every iteration, where the INN-optimized image is composed of the coarse information given by the observed degraded image and the details generated by the diffusion process. With the help of INN, our algorithm effectively estimates the details lost in the degradation process and is no longer limited by the requirement of knowing the closed-form expression of the degradation model. Experiments demonstrate that our algorithm obtains competitive results compared with recently leading methods both quantitatively and visually. Moreover, our algorithm performs well on more complex degradation models and real-world low-quality images.

READ FULL TEXT

page 1

page 3

page 5

page 6

research
09/01/2023

Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolution

Using diffusion models to solve inverse problems is a growing field of r...
research
11/19/2022

Parallel Diffusion Models of Operator and Image for Blind Inverse Problems

Diffusion model-based inverse problem solvers have demonstrated state-of...
research
03/10/2023

Fast Diffusion Sampler for Inverse Problems by Geometric Decomposition

Diffusion models have shown exceptional performance in solving inverse p...
research
03/25/2023

DiracDiffusion: Denoising and Incremental Reconstruction with Assured Data-Consistency

Diffusion models have established new state of the art in a multitude of...
research
09/12/2023

Adapt and Diffuse: Sample-adaptive Reconstruction via Latent Diffusion Models

Inverse problems arise in a multitude of applications, where the goal is...
research
03/07/2023

Diffusion in the Dark: A Diffusion Model for Low-Light Text Recognition

Images are indispensable for the automation of high-level tasks, such as...
research
07/11/2023

DDGM: Solving inverse problems by Diffusive Denoising of Gradient-based Minimization

Inverse problems generally require a regularizer or prior for a good sol...

Please sign up or login with your details

Forgot password? Click here to reset