Credit Assignment as a Proxy for Transfer in Reinforcement Learning

07/18/2019
by   Johan Ferret, et al.
2

The ability to transfer representations to novel environments and tasks is a sensible requirement for general learning agents. Despite the apparent promises, transfer in Reinforcement Learning is still an open and under-exploited research area. In this paper, we suggest that credit assignment, regarded as a supervised learning task, could be used to accomplish transfer. Our contribution is twofold: we introduce a new credit assignment mechanism based on self-attention, and show that the learned credit can be transferred to in-domain and out-of-domain scenarios.

READ FULL TEXT

page 6

page 16

research
12/05/2019

Hindsight Credit Assignment

We consider the problem of efficient credit assignment in reinforcement ...
research
03/10/2021

An Information-Theoretic Perspective on Credit Assignment in Reinforcement Learning

How do we formalize the challenge of credit assignment in reinforcement ...
research
03/07/2022

On Credit Assignment in Hierarchical Reinforcement Learning

Hierarchical Reinforcement Learning (HRL) has held longstanding promise ...
research
10/26/2020

Forethought and Hindsight in Credit Assignment

We address the problem of credit assignment in reinforcement learning an...
research
06/01/2022

Predecessor Features

Any reinforcement learning system must be able to identify which past ev...
research
07/16/2023

Credit Assignment: Challenges and Opportunities in Developing Human-like AI Agents

Temporal credit assignment is crucial for learning and skill development...
research
07/03/2009

Credit Assignment in Adaptive Evolutionary Algorithms

In this paper, a new method for assigning credit to search operators is ...

Please sign up or login with your details

Forgot password? Click here to reset