Active learning for distributionally robust level-set estimation

by   Yu Inatsu, et al.

Many cases exist in which a black-box function f with high evaluation cost depends on two types of variables x and w, where x is a controllable design variable and w are uncontrollable environmental variables that have random variation following a certain distribution P. In such cases, an important task is to find the range of design variables x such that the function f( x, w) has the desired properties by incorporating the random variation of the environmental variables w. A natural measure of robustness is the probability that f( x, w) exceeds a given threshold h, which is known as the probability threshold robustness (PTR) measure in the literature on robust optimization. However, this robustness measure cannot be correctly evaluated when the distribution P is unknown. In this study, we addressed this problem by considering the distributionally robust PTR (DRPTR) measure, which considers the worst-case PTR within given candidate distributions. Specifically, we studied the problem of efficiently identifying a reliable set H, which is defined as a region in which the DRPTR measure exceeds a certain desired probability α, which can be interpreted as a level set estimation (LSE) problem for DRPTR. We propose a theoretically grounded and computationally efficient active learning method for this problem. We show that the proposed method has theoretical guarantees on convergence and accuracy, and confirmed through numerical experiments that the proposed method outperforms existing methods.


page 1

page 2

page 3

page 4


Bayesian Optimization for Distributionally Robust Chance-constrained Problem

In black-box function optimization, we need to consider not only control...

Bayesian Quadrature Optimization for Probability Threshold Robustness Measure

In many product development problems, the performance of the product is ...

Distributionally Robust Multi-objective Bayesian Optimization under Uncertain Environments

In this study, we address the problem of optimizing multi-output black-b...

Bayesian Experimental Design for Finding Reliable Level Set under Input Uncertainty

In the manufacturing industry, it is often necessary to repeat expensive...

Bayesian Active Learning for Structured Output Design

In this paper, we propose an active learning method for an inverse probl...

Decision Trees for Function Evaluation - Simultaneous Optimization of Worst and Expected Cost

In several applications of automatic diagnosis and active learning a cen...

Bayesian Quadrature for Probability Threshold Robustness of Partially Undefined Functions

In engineering design, one often wishes to calculate the probability tha...

Please sign up or login with your details

Forgot password? Click here to reset