Neural Control Variates

06/02/2020
by   Thomas Müller, et al.
0

We propose neural control variates (NCV) for unbiased variance reduction in parametric Monte Carlo integration. So far, the core challenge of applying the method of control variates has been finding a good approximation of the integrand that is cheap to integrate. We show that a set of neural networks can face that challenge: a normalizing flow that approximates the shape of the integrand and another neural network that infers the solution of the integral equation. We also propose to leverage a neural importance sampler to estimate the difference between the original integrand and the learned control variate. To optimize the resulting parametric estimator, we derive a theoretically optimal, variance-minimizing loss function, and propose an alternative, composite loss for stable online training in practice. When applied to light transport simulation, neural control variates are capable of matching the state-of-the-art performance of other unbiased approaches, while providing means to develop more performant, practical solutions. Specifically, we show that the learned light-field approximation is of sufficient quality for high-order bounces, allowing us to omit the error correction and thereby dramatically reduce the noise at the cost of negligible visible bias.

READ FULL TEXT

page 1

page 6

page 9

page 10

page 12

page 14

page 15

research
12/17/2017

Integral Equations and Machine Learning

As both light transport simulation and reinforcement learning are ruled ...
research
06/01/2018

Neural Control Variates for Variance Reduction

In statistics and machine learning, approximation of an intractable inte...
research
12/17/2017

Machine Learning and Integral Equations

As both light transport simulation and reinforcement learning are ruled ...
research
09/26/2022

Neural variance reduction for stochastic differential equations

Variance reduction techniques are of crucial importance for the efficien...
research
05/02/2022

A Position-Free Path Integral for Homogeneous Slabs and Multiple Scattering on Smith Microfacets

We consider the problem of multiple scattering on Smith microfacets. Thi...
research
07/24/2023

Policy Gradient Optimal Correlation Search for Variance Reduction in Monte Carlo simulation and Maximum Optimal Transport

We propose a new algorithm for variance reduction when estimating f(X_T)...
research
02/20/2021

An unbiased ray-marching transmittance estimator

We present an in-depth analysis of the sources of variance in state-of-t...

Please sign up or login with your details

Forgot password? Click here to reset