Deep Learning for Content-based Personalized Viewport Prediction of 360-Degree VR Videos

03/01/2020
by   Xinwei Chen, et al.
0

In this paper, the problem of head movement prediction for virtual reality videos is studied. In the considered model, a deep learning network is introduced to leverage position data as well as video frame content to predict future head movement. For optimizing data input into this neural network, data sample rate, reduced data, and long-period prediction length are also explored for this model. Simulation results show that the proposed approach yields 16.1% improvement in terms of prediction accuracy compared to a baseline approach that relies only on the position data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/06/2022

Subtitle-based Viewport Prediction for 360-degree Virtual Tourism Video

360-degree streaming videos can provide a rich immersive experiences to ...
research
12/08/2022

Head Movement Modeling for Immersive Visualization in VR

Virtual Reality, and Extended Reality in general, connect the physical b...
research
11/26/2019

Revisiting Deep Architectures for Head Motion Prediction in 360° Videos

Head motion prediction is an important problem with 360 videos, in parti...
research
08/16/2019

Towards Generating Ambisonics Using Audio-Visual Cue for Virtual Reality

Ambisonics i.e., a full-sphere surround sound, is quintessential with 36...
research
08/21/2021

Using Trajectory Compression Rate to Predict Changes in Cybersickness in Virtual Reality Games

Identifying cybersickness in virtual reality (VR) applications such as g...
research
12/20/2022

Robust and Resource-efficient Machine Learning Aided Viewport Prediction in Virtual Reality

360-degree panoramic videos have gained considerable attention in recent...
research
10/21/2020

Towards Real-time Drowsiness Detection for Elderly Care

The primary focus of this paper is to produce a proof of concept for ext...

Please sign up or login with your details

Forgot password? Click here to reset