Boosting the Performance of Video Compression Artifact Reduction with Reference Frame Proposals and Frequency Domain Information

05/31/2021
by   Yi Xu, et al.
0

Many deep learning based video compression artifact removal algorithms have been proposed to recover high-quality videos from low-quality compressed videos. Recently, methods were proposed to mine spatiotemporal information via utilizing multiple neighboring frames as reference frames. However, these post-processing methods take advantage of adjacent frames directly, but neglect the information of the video itself, which can be exploited. In this paper, we propose an effective reference frame proposal strategy to boost the performance of the existing multi-frame approaches. Besides, we introduce a loss based on fast Fourier transformation (FFT) to further improve the effectiveness of restoration. Experimental results show that our method achieves better fidelity and perceptual performance on MFQE 2.0 dataset than the state-of-the-art methods. And our method won Track 1 and Track 2, and was ranked the 2nd in Track 3 of NTIRE 2021 Quality enhancement of heavily compressed videos Challenge.

READ FULL TEXT

page 1

page 3

page 5

page 7

page 8

research
08/04/2021

Recursive Fusion and Deformable Spatiotemporal Attention for Video Compression Artifact Reduction

A number of deep learning based algorithms have been proposed to recover...
research
10/27/2019

Non-Local ConvLSTM for Video Compression Artifact Reduction

Video compression artifact reduction aims to recover high-quality videos...
research
03/21/2023

Lightweight Hybrid Video Compression Framework Using Reference-Guided Restoration Network

Recent deep-learning-based video compression methods brought coding gain...
research
06/15/2023

1st Solution Places for CVPR 2023 UG^2+ Challenge Track 2.2-Coded Target Restoration through Atmospheric Turbulence

In this technical report, we briefly introduce the solution of our team ...
research
12/08/2017

Variational models for joint subsampling and reconstruction of turbulence-degraded images

Turbulence-degraded image frames are distorted by both turbulent deforma...
research
06/16/2022

PeQuENet: Perceptual Quality Enhancement of Compressed Video with Adaptation- and Attention-based Network

In this paper we propose a generative adversarial network (GAN) framewor...
research
10/09/2020

Video Quality Enhancement Using Deep Learning-Based Prediction Models for Quantized DCT Coefficients in MPEG I-frames

Recent works have successfully applied some types of Convolutional Neura...

Please sign up or login with your details

Forgot password? Click here to reset