Shape and Spatially-Varying Reflectance Estimation From Virtual Exemplars

by   Zhuo Hui, et al.

This paper addresses the problem of estimating the shape of objects that exhibit spatially-varying reflectance. We assume that multiple images of the object are obtained under a fixed view-point and varying illumination, i.e., the setting of photometric stereo. At the core of our techniques is the assumption that the BRDF at each pixel lies in the non-negative span of a known BRDF dictionary.This assumption enables a per-pixel surface normal and BRDF estimation framework that is computationally tractable and requires no initialization in spite of the underlying problem being non-convex. Our estimation framework first solves for the surface normal at each pixel using a variant of example-based photometric stereo. We design an efficient multi-scale search strategy for estimating the surface normal and subsequently, refine this estimate using a gradient descent procedure. Given the surface normal estimate, we solve for the spatially-varying BRDF by constraining the BRDF at each pixel to be in the span of the BRDF dictionary, here, we use additional priors to further regularize the solution. A hallmark of our approach is that it does not require iterative optimization techniques nor the need for careful initialization, both of which are endemic to most state-of-the-art techniques. We showcase the performance of our technique on a wide range of simulated and real scenes where we outperform competing methods.


page 2

page 4

page 6

page 10

page 11

page 12

page 13

page 14


A Dictionary-based Approach for Estimating Shape and Spatially-Varying Reflectance

We present a technique for estimating the shape and reflectance of an ob...

Robust Photometric Stereo Using Learned Image and Gradient Dictionaries

Photometric stereo is a method for estimating the normal vectors of an o...

One Ring to Rule Them All: a simple solution to multi-view 3D-Reconstruction of shapes with unknown BRDF via a small Recurrent ResNet

This paper proposes a simple method which solves an open problem of mult...

nLMVS-Net: Deep Non-Lambertian Multi-View Stereo

We introduce a novel multi-view stereo (MVS) method that can simultaneou...

Photometric Stereo by UV-Induced Fluorescence to Detect Protrusions on Georgia O'Keeffe's Paintings

A significant number of oil paintings produced by Georgia O'Keeffe (1887...

Single-image RGB Photometric Stereo With Spatially-varying Albedo

We present a single-shot system to recover surface geometry of objects w...

Deep Uncalibrated Photometric Stereo via Inter-Intra Image Feature Fusion

Uncalibrated photometric stereo is proposed to estimate the detailed sur...

Please sign up or login with your details

Forgot password? Click here to reset