MELON: NeRF with Unposed Images Using Equivalence Class Estimation

03/14/2023
by   Axel Levy, et al.
0

Neural radiance fields enable novel-view synthesis and scene reconstruction with photorealistic quality from a few images, but require known and accurate camera poses. Conventional pose estimation algorithms fail on smooth or self-similar scenes, while methods performing inverse rendering from unposed views require a rough initialization of the camera orientations. The main difficulty of pose estimation lies in real-life objects being almost invariant under certain transformations, making the photometric distance between rendered views non-convex with respect to the camera parameters. Using an equivalence relation that matches the distribution of local minima in camera space, we reduce this space to its quotient set, in which pose estimation becomes a more convex problem. Using a neural-network to regularize pose estimation, we demonstrate that our method - MELON - can reconstruct a neural radiance field from unposed images with state-of-the-art accuracy while requiring ten times fewer views than adversarial approaches.

READ FULL TEXT

page 5

page 6

page 7

page 8

page 14

page 16

page 17

research
12/10/2020

iNeRF: Inverting Neural Radiance Fields for Pose Estimation

We present iNeRF, a framework that performs pose estimation by "invertin...
research
04/12/2022

GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation

Despite Neural Radiance Fields (NeRF) showing compelling results in phot...
research
06/07/2023

BAA-NGP: Bundle-Adjusting Accelerated Neural Graphics Primitives

Implicit neural representation has emerged as a powerful method for reco...
research
08/29/2023

Pose-Free Neural Radiance Fields via Implicit Pose Regularization

Pose-free neural radiance fields (NeRF) aim to train NeRF with unposed m...
research
08/01/2023

Robust Single-view Cone-beam X-ray Pose Estimation with Neural Tuned Tomography (NeTT) and Masked Neural Radiance Fields (mNeRF)

Many tasks performed in image-guided, mini-invasive, medical procedures ...
research
10/18/2022

Parallel Inversion of Neural Radiance Fields for Robust Pose Estimation

We present a parallelized optimization method based on fast Neural Radia...
research
03/08/2023

DroNeRF: Real-time Multi-agent Drone Pose Optimization for Computing Neural Radiance Fields

We present a novel optimization algorithm called DroNeRF for the autonom...

Please sign up or login with your details

Forgot password? Click here to reset