Adaptive User Perspective Rendering for Handheld Augmented Reality

by   Peter Mohr, et al.

Handheld Augmented Reality commonly implements some variant of magic lens rendering, which turns only a fraction of the user's real environment into AR while the rest of the environment remains unaffected. Since handheld AR devices are commonly equipped with video see-through capabilities, AR magic lens applications often suffer from spatial distortions, because the AR environment is presented from the perspective of the camera of the mobile device. Recent approaches counteract this distortion based on estimations of the user's head position, rendering the scene from the user's perspective. To this end, approaches usually apply face-tracking algorithms on the front camera of the mobile device. However, this demands high computational resources and therefore commonly affects the performance of the application beyond the already high computational load of AR applications. In this paper, we present a method to reduce the computational demands for user perspective rendering by applying lightweight optical flow tracking and an estimation of the user's motion before head tracking is started. We demonstrate the suitability of our approach for computationally limited mobile devices and we compare it to device perspective rendering, to head tracked user perspective rendering, as well as to fixed point of view user perspective rendering.


page 1

page 3

page 4


Towards a QoE Model to Evaluate Holographic Augmented Reality Devices

Augmented reality (AR) technology is developing fast and provides users ...

Dynamic Environment Mapping for Augmented Reality Applications on Mobile Devices

Augmented Reality is a topic of foremost interest nowadays. Its main goa...

Masking Effects in Combined Hardness and Stiffness Rendering Using an Encountered-Type Haptic Display

Rendering stable hard surfaces is an important problem in haptics for ma...

Motion model transitions in GPS-IMU sensor fusion for user tracking in augmented reality

Finding the position of the user is an important processing step for aug...

Image Stabilization for Hololens Camera in Remote Collaboration

With the advent of new technologies, Augmented Reality (AR) has become a...

Kalman Filter-based Head Motion Prediction for Cloud-based Mixed Reality

Volumetric video allows viewers to experience highly-realistic 3D conten...

Multi-Camera Lighting Estimation for Photorealistic Front-Facing Mobile Augmented Reality

Lighting understanding plays an important role in virtual object composi...

Please sign up or login with your details

Forgot password? Click here to reset