Perceptual Image Restoration with High-Quality Priori and Degradation Learning

03/04/2021
by   Chaoyi Han, et al.
0

Perceptual image restoration seeks for high-fidelity images that most likely degrade to given images. For better visual quality, previous work proposed to search for solutions within the natural image manifold, by exploiting the latent space of a generative model. However, the quality of generated images are only guaranteed when latent embedding lies close to the prior distribution. In this work, we propose to restrict the feasible region within the prior manifold. This is accomplished with a non-parametric metric for two distributions: the Maximum Mean Discrepancy (MMD). Moreover, we model the degradation process directly as a conditional distribution. We show that our model performs well in measuring the similarity between restored and degraded images. Instead of optimizing the long criticized pixel-wise distance over degraded images, we rely on such model to find visual pleasing images with high probability. Our simultaneous restoration and enhancement framework generalizes well to real-world complicated degradation types. The experimental results on perceptual quality and no-reference image quality assessment (NR-IQA) demonstrate the superior performance of our method.

READ FULL TEXT

page 4

page 6

page 7

page 8

page 9

research
04/03/2023

Generative Diffusion Prior for Unified Image Restoration and Enhancement

Existing image restoration methods mostly leverage the posterior distrib...
research
05/02/2022

Conformer and Blind Noisy Students for Improved Image Quality Assessment

Generative models for image restoration, enhancement, and generation hav...
research
08/14/2013

Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index

It is an important task to faithfully evaluate the perceptual quality of...
research
03/20/2023

Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restoration

Inversion by Direct Iteration (InDI) is a new formulation for supervised...
research
11/09/2022

From Distance to Dependency: A Paradigm Shift of Full-reference Image Quality Assessment

Deep learning-based full-reference image quality assessment (FR-IQA) mod...
research
08/05/2022

DeepWSD: Projecting Degradations in Perceptual Space to Wasserstein Distance in Deep Feature Space

Existing deep learning-based full-reference IQA (FR-IQA) models usually ...
research
08/04/2021

Optimal Transport for Unsupervised Restoration Learning

Recently, much progress has been made in unsupervised restoration learni...

Please sign up or login with your details

Forgot password? Click here to reset