Adaptive Sparse Gaussian Process

by   Vanessa Gómez-Verdejo, et al.
Universidad Carlos III de Madrid

Adaptive learning is necessary for non-stationary environments where the learning machine needs to forget past data distribution. Efficient algorithms require a compact model update to not grow in computational burden with the incoming data and with the lowest possible computational cost for online parameter updating. Existing solutions only partially cover these needs. Here, we propose the first adaptive sparse Gaussian Process (GP) able to address all these issues. We first reformulate a variational sparse GP algorithm to make it adaptive through a forgetting factor. Next, to make the model inference as simple as possible, we propose updating a single inducing point of the sparse GP model together with the remaining model parameters every time a new sample arrives. As a result, the algorithm presents a fast convergence of the inference process, which allows an efficient model update (with a single inference iteration) even in highly non-stationary environments. Experimental results demonstrate the capabilities of the proposed algorithm and its good performance in modeling the predictive posterior in mean and confidence interval estimation compared to state-of-the-art approaches.


page 1

page 2

page 3

page 4


Efficient Transformed Gaussian Processes for Non-Stationary Dependent Multi-class Classification

This work introduces the Efficient Transformed Gaussian Process (ETGP), ...

EigenGP: Sparse Gaussian process models with data-dependent eigenfunctions

Gaussian processes (GPs) provide a nonparametric representation of funct...

Adaptive Configuration Oracle for Online Portfolio Selection Methods

Financial markets are complex environments that produce enormous amounts...

BAM: Bayes with Adaptive Memory

Online learning via Bayes' theorem allows new data to be continuously in...

Recursive Sparse Pseudo-input Gaussian Process SARSA

The class of Gaussian Process (GP) methods for Temporal Difference learn...

Likelihood Inference for Possibly Non-Stationary Processes via Adaptive Overdifferencing

We make a simple observation that facilitates valid likelihood-based inf...

Bayesian model-data synthesis with an application to global Glacio-Isostatic Adjustment

We introduce a framework for updating large scale geospatial processes u...

Code Repositories

Please sign up or login with your details

Forgot password? Click here to reset