SVBRDF Recovery From a Single Image With Highlights using a Pretrained Generative Adversarial Network

by   Tao Wen, et al.

Spatially-varying bi-directional reflectance distribution functions (SVBRDFs) are crucial for designers to incorporate new materials in virtual scenes, making them look more realistic. Reconstruction of SVBRDFs is a long-standing problem. Existing methods either rely on extensive acquisition system or require huge datasets which are nontrivial to acquire. We aim to recover SVBRDFs from a single image, without any datasets. A single image contains incomplete information about the SVBRDF, making the reconstruction task highly ill-posed. It is also difficult to separate between the changes in color that are caused by the material and those caused by the illumination, without the prior knowledge learned from the dataset. In this paper, we use an unsupervised generative adversarial neural network (GAN) to recover SVBRDFs maps with a single image as input. To better separate the effects due to illumination from the effects due to the material, we add the hypothesis that the material is stationary and introduce a new loss function based on Fourier coefficients to enforce this stationarity. For efficiency, we train the network in two stages: reusing a trained model to initialize the SVBRDFs and fine-tune it based on the input image. Our method generates high-quality SVBRDFs maps from a single input photograph, and provides more vivid rendering results compared to previous work. The two-stage training boosts runtime performance, making it 8 times faster than previous work.


page 1

page 4

page 5

page 7

page 8

page 9

page 10

page 11


SurfaceNet: Adversarial SVBRDF Estimation from a Single Image

In this paper we present SurfaceNet, an approach for estimating spatiall...

DeLight-Net: Decomposing Reflectance Maps into Specular Materials and Natural Illumination

In this paper we are extracting surface reflectance and natural environm...

Generative Model for Material Experiments Based on Prior Knowledge and Attention Mechanism

Material irradiation experiment is dangerous and complex, thus it requir...

Diffuse Map Guiding Unsupervised Generative Adversarial Network for SVBRDF Estimation

Reconstructing materials in the real world has always been a difficult p...

Improved Techniques for Training Single-Image GANs

Recently there has been an interest in the potential of learning generat...

Single Image BRDF Parameter Estimation with a Conditional Adversarial Network

Creating plausible surfaces is an essential component in achieving a hig...

Single-Image SVBRDF Capture with a Rendering-Aware Deep Network

Texture, highlights, and shading are some of many visual cues that allow...

Please sign up or login with your details

Forgot password? Click here to reset