Lévy walks derived from a Bayesian decision-making model in non-stationary environments

12/16/2020
by   Shuji Shinohara, et al.
0

Lévy walks are found in the migratory behaviour patterns of various organisms, and the reason for this phenomenon has been much discussed. We use simulations to demonstrate that learning causes the changes in confidence level during decision-making in non-stationary environments, and results in Lévy-walk-like patterns. One inference algorithm involving confidence is Bayesian inference. We propose an algorithm that introduces the effects of learning and forgetting into Bayesian inference, and simulate an imitation game in which two decision-making agents incorporating the algorithm estimate each other's internal models from their opponent's observational data. For forgetting without learning, agent confidence levels remained low due to a lack of information on the counterpart and Brownian walks occurred for a wide range of forgetting rates. Conversely, when learning was introduced, high confidence levels occasionally occurred even at high forgetting rates, and Brownian walks universally became Lévy walks through a mixture of high- and low-confidence states.

READ FULL TEXT
07/07/2023

BOF-UCB: A Bayesian-Optimistic Frequentist Algorithm for Non-Stationary Contextual Bandits

We propose a novel Bayesian-Optimistic Frequentist Upper Confidence Boun...
07/05/2019

An Approximate Bayesian Approach to Surprise-Based Learning

Surprise-based learning allows agents to adapt quickly in non-stationary...
01/13/2022

Non-Stationary Representation Learning in Sequential Linear Bandits

In this paper, we study representation learning for multi-task decision-...
11/06/2018

On the role of neurogenesis in overcoming catastrophic forgetting

Lifelong learning capabilities are crucial for artificial autonomous age...
02/04/2022

BAM: Bayes with Adaptive Memory

Online learning via Bayes' theorem allows new data to be continuously in...
03/27/2023

Confidence distributions for the autoregressive parameter

The notion of confidence distributions is applied to inference about the...

Please sign up or login with your details

Forgot password? Click here to reset