Low Latency Volumetric Video Edge Cloud Streaming
share
Volumetric video is an emerging key technology for immersive representation of 3D spaces and objects. The enhanced immersion of volumetric videos leads to new use cases such as streaming of six-degrees-of-freedom (6DoF) videos in which the user can freely change his position and orientation. However, rendering volumetric videos as 3D representations (mesh or point cloud) requires lots of computational power and transmission of such volumetric data requires lots of bandwidth. To mitigate this issue, rendering a 2D view from the volumetric data at a cloud/edge server and streaming that as a 2D video is a feasible solution. However, network-based processing brings additional network and processing latency. In order to reduce the motion-to-photon latency, prediction of the future user pose is necessary. We developed a 6DoF user movement prediction model for very low latency streaming services and investigated its potential to further reduce the motion-to-photon latency for different prediction windows. Our results show that the developed prediction model on average reduces the positional rendering errors caused by the motion-to-photon latency compared to a baseline system in which no prediction is performed.
READ FULL TEXT