Computing Egomotion with Local Loop Closures for Egocentric Videos

01/17/2017
by   Suvam Patra, et al.
0

Finding the camera pose is an important step in many egocentric video applications. It has been widely reported that, state of the art SLAM algorithms fail on egocentric videos. In this paper, we propose a robust method for camera pose estimation, designed specifically for egocentric videos. In an egocentric video, the camera views the same scene point multiple times as the wearer's head sweeps back and forth. We use this specific motion profile to perform short loop closures aligned with wearer's footsteps. For egocentric videos, depth estimation is usually noisy. In an important departure, we use 2D computations for rotation averaging which do not rely upon depth estimates. The two modification results in much more stable algorithm as is evident from our experiments on various egocentric video datasets for different egocentric applications. The proposed algorithm resolves a long standing problem in egocentric vision and unlocks new usage scenarios for future applications.

READ FULL TEXT

page 6

page 7

page 8

research
07/18/2017

Batch based Monocular SLAM for Egocentric Videos

Simultaneous Localization and Mapping (SLAM) from a monocular camera has...
research
05/05/2018

Position Estimation of Camera Based on Unsupervised Learning

It is an exciting task to recover the scene's 3d-structure and camera po...
research
02/05/2021

Sampling Based Scene-Space Video Processing

Many compelling video processing effects can be achieved if per-pixel de...
research
06/04/2020

Unsupervised Depth Learning in Challenging Indoor Video: Weak Rectification to Rescue

Single-view depth estimation using CNNs trained from unlabelled videos h...
research
09/13/2018

Video to Fully Automatic 3D Hair Model

Imagine taking a selfie video with your mobile phone and getting as outp...
research
08/04/2022

Globally Consistent Video Depth and Pose Estimation with Efficient Test-Time Training

Dense depth and pose estimation is a vital prerequisite for various vide...
research
07/20/2019

Pan-tilt-zoom SLAM for Sports Videos

We present an online SLAM system specifically designed to track pan-tilt...

Please sign up or login with your details

Forgot password? Click here to reset