Block-NeRF: Scalable Large Scene Neural View Synthesis

02/10/2022
by   Matthew Tancik, et al.
0

We present Block-NeRF, a variant of Neural Radiance Fields that can represent large-scale environments. Specifically, we demonstrate that when scaling NeRF to render city-scale scenes spanning multiple blocks, it is vital to decompose the scene into individually trained NeRFs. This decomposition decouples rendering time from scene size, enables rendering to scale to arbitrarily large environments, and allows per-block updates of the environment. We adopt several architectural changes to make NeRF robust to data captured over months under different environmental conditions. We add appearance embeddings, learned pose refinement, and controllable exposure to each individual NeRF, and introduce a procedure for aligning appearance between adjacent NeRFs so that they can be seamlessly combined. We build a grid of Block-NeRFs from 2.8 million images to create the largest neural scene representation to date, capable of rendering an entire neighborhood of San Francisco.

READ FULL TEXT

page 2

page 3

page 4

page 6

page 9

page 10

page 11

page 12

research
03/26/2021

Baking Neural Radiance Fields for Real-Time View Synthesis

Neural volumetric representations such as Neural Radiance Fields (NeRF) ...
research
12/10/2019

Neural Voxel Renderer: Learning an Accurate and Controllable Rendering Tool

We present a neural rendering framework that maps a voxelized scene into...
research
12/20/2021

Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughs

We use neural radiance fields (NeRFs) to build interactive 3D environmen...
research
08/10/2021

FLAME-in-NeRF : Neural control of Radiance Fields for Free View Face Animation

This paper presents a neural rendering method for controllable portrait ...
research
10/02/2022

IntrinsicNeRF: Learning Intrinsic Neural Radiance Fields for Editable Novel View Synthesis

We present intrinsic neural radiance fields, dubbed IntrinsicNeRF, that ...
research
04/15/2021

GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worlds

We present GANcraft, an unsupervised neural rendering framework for gene...
research
11/25/2020

DeRF: Decomposed Radiance Fields

With the advent of Neural Radiance Fields (NeRF), neural networks can no...

Please sign up or login with your details

Forgot password? Click here to reset