Understanding the World to Solve Social Dilemmas Using Multi-Agent Reinforcement Learning

05/19/2023
by   Manuel Rios, et al.
0

Social dilemmas are situations where groups of individuals can benefit from mutual cooperation but conflicting interests impede them from doing so. This type of situations resembles many of humanity's most critical challenges, and discovering mechanisms that facilitate the emergence of cooperative behaviors is still an open problem. In this paper, we study the behavior of self-interested rational agents that learn world models in a multi-agent reinforcement learning (RL) setting and that coexist in environments where social dilemmas can arise. Our simulation results show that groups of agents endowed with world models outperform all the other tested ones when dealing with scenarios where social dilemmas can arise. We exploit the world model architecture to qualitatively assess the learnt dynamics and confirm that each agent's world model is capable to encode information of the behavior of the changing environment and the other agent's actions. This is the first work that shows that world models facilitate the emergence of complex coordinated behaviors that enable interacting agents to “understand” both environmental and social dynamics.

READ FULL TEXT

page 2

page 4

page 5

01/25/2020

Silly rules improve the capacity of agents to learn stable enforcement and compliance behaviors

How can societies learn to enforce and comply with social norms? Here we...
10/23/2022

A Cooperative Reinforcement Learning Environment for Detecting and Penalizing Betrayal

In this paper we present a Reinforcement Learning environment that lever...
05/13/2022

Emergent Bartering Behaviour in Multi-Agent Reinforcement Learning

Advances in artificial intelligence often stem from the development of n...
08/21/2023

AgentVerse: Facilitating Multi-Agent Collaboration and Exploring Emergent Behaviors in Agents

Autonomous agents empowered by Large Language Models (LLMs) have undergo...
11/10/2020

Emergent Reciprocity and Team Formation from Randomized Uncertain Social Preferences

Multi-agent reinforcement learning (MARL) has shown recent success in in...

Please sign up or login with your details

Forgot password? Click here to reset