Gaussian Function On Response Surface Estimation

by   Mohammadhossein Toutiaee, et al.
University of Georgia

We propose a new framework for 2-D interpreting (features and samples) black-box machine learning models via a metamodeling technique, by which we study the output and input relationships of the underlying machine learning model. The metamodel can be estimated from data generated via a trained complex model by running the computer experiment on samples of data in the region of interest. We utilize a Gaussian process as a surrogate to capture the response surface of a complex model, in which we incorporate two parts in the process: interpolated values that are modeled by a stationary Gaussian process Z governed by a prior covariance function, and a mean function mu that captures the known trends in the underlying model. The optimization procedure for the variable importance parameter theta is to maximize the likelihood function. This theta corresponds to the correlation of individual variables with the target response. There is no need for any pre-assumed models since it depends on empirical observations. Experiments demonstrate the potential of the interpretable model through quantitative assessment of the predicted samples.


Heteroscedastic Treed Bayesian Optimisation

Optimising black-box functions is important in many disciplines, such as...

Multifidelity Bayesian Optimization for Binomial Output

The key idea of Bayesian optimization is replacing an expensive target f...

Asymptotic Bounds for Smoothness Parameter Estimates in Gaussian Process Interpolation

It is common to model a deterministic response function, such as the out...

Efficient Transfer Bayesian Optimization with Auxiliary Information

We propose an efficient transfer Bayesian optimization method, which fin...

A Generalized Variable Importance Metric and Estimator for Black Box Machine Learning Models

The aim of this study is to define importance of predictors for black bo...

Compressive Estimation of a Stochastic Process with Unknown Autocorrelation Function

In this paper, we study the prediction of a circularly symmetric zero-me...

Please sign up or login with your details

Forgot password? Click here to reset