DFPN: Deformable Frame Prediction Network

05/26/2021
by   M. Akin Yilmaz, et al.
0

Learned frame prediction is a current problem of interest in computer vision and video compression. Although several deep network architectures have been proposed for learned frame prediction, to the best of our knowledge, there is no work based on using deformable convolutions for frame prediction. To this effect, we propose a deformable frame prediction network (DFPN) for task oriented implicit motion modeling and next frame prediction. Experimental results demonstrate that the proposed DFPN model achieves state of the art results in next frame prediction. Our models and results are available at https://github.com/makinyilmaz/DFPN.

READ FULL TEXT
research
05/20/2021

FVC: A New Framework towards Deep Video Compression in Feature Space

Learning based video compression attracts increasing attention in the pa...
research
07/17/2020

Can Learned Frame-Prediction Compete with Block-Motion Compensation for Video Coding?

Given recent advances in learned video prediction, we investigate whethe...
research
02/25/2018

A Dataset To Evaluate The Representations Learned By Video Prediction Models

We present a parameterized synthetic dataset called Moving Symbols to su...
research
05/05/2022

MMINR: Multi-frame-to-Multi-frame Inference with Noise Resistance for Precipitation Nowcasting with Radar

Precipitation nowcasting based on radar echo maps is essential in meteor...
research
08/19/2021

Learned Video Compression with Residual Prediction and Loop Filter

In this paper, we propose a learned video codec with a residual predicti...
research
04/14/2022

Deformable Sprites for Unsupervised Video Decomposition

We describe a method to extract persistent elements of a dynamic scene f...
research
11/13/2020

Adaptive Future Frame Prediction with Ensemble Network

Future frame prediction in videos is a challenging problem because video...

Please sign up or login with your details

Forgot password? Click here to reset