Online Prediction With History-Dependent Experts: The General Case

by   Nadejda Drenska, et al.

We study the problem of prediction of binary sequences with expert advice in the online setting, which is a classic example of online machine learning. We interpret the binary sequence as the price history of a stock, and view the predictor as an investor, which converts the problem into a stock prediction problem. In this framework, an investor, who predicts the daily movements of a stock, and an adversarial market, who controls the stock, play against each other over N turns. The investor combines the predictions of n≥ 2 experts in order to make a decision about how much to invest at each turn, and aims to minimize their regret with respect to the best-performing expert at the end of the game. We consider the problem with history-dependent experts, in which each expert uses the previous d days of history of the market in making their predictions. We prove that the value function for this game, rescaled appropriately, converges as N→∞ at a rate of O(N^-1/6) to the viscosity solution of a nonlinear degenerate elliptic PDE, which can be understood as the Hamilton-Jacobi-Issacs equation for the two-person game. As a result, we are able to deduce asymptotically optimal strategies for the investor. Our results extend those established by the first author and R.V.Kohn [13] for n=2 experts and d≤ 4 days of history.


page 1

page 2

page 3

page 4


A PDE Approach to the Prediction of a Binary Sequence with Advice from Two History-Dependent Experts

The prediction of a binary sequence is a classic example of online machi...

Asymptotically optimal strategies for online prediction with history-dependent experts

We establish sharp asymptotically optimal strategies for the problem of ...

New Potential-Based Bounds for Prediction with Expert Advice

This work addresses the classic machine learning problem of online predi...

Prediction with Expert Advice: a PDE Perspective

This work addresses a classic problem of online prediction with expert a...

Advice-Efficient Prediction with Expert Advice

Advice-efficient prediction with expert advice (in analogy to label-effi...

Applying Convolutional Neural Networks for Stock Market Trends Identification

In this paper we apply a specific type ANNs - convolutional neural netwo...

Adversarial Policies in Learning Systems with Malicious Experts

We consider a learning system based on the conventional multiplicative w...

Please sign up or login with your details

Forgot password? Click here to reset